-- Logs begin at Sat 2022-09-24 20:01:15 UTC, end at Sat 2022-09-24 20:59:21 UTC. -- Sep 24 20:31:44.129503 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Sep 24 20:31:44.138123 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 24 20:31:44.140295 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 24 20:31:44 2022] *** Sep 24 20:31:44.140295 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 20:31:44.140295 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 20:31:44.140295 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: nodename: dv-osbrick-master-4-ceph Sep 24 20:31:44.140295 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: machine: x86_64 Sep 24 20:31:44.140295 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: clock source: unix Sep 24 20:31:44.140295 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: pcre jit disabled Sep 24 20:31:44.140295 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: detected number of CPU cores: 4 Sep 24 20:31:44.140295 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: current working directory: / Sep 24 20:31:44.140295 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: detected binary path: /usr/bin/uwsgi-core Sep 24 20:31:44.140295 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: your processes number limit is 47680 Sep 24 20:31:44.140295 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: your memory page size is 4096 bytes Sep 24 20:31:44.140295 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: detected max file descriptor number: 2048 Sep 24 20:31:44.140295 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: lock engine: pthread robust mutexes Sep 24 20:31:44.141158 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: thunder lock: enabled Sep 24 20:31:44.141158 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 24 20:31:44.141158 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 24 20:31:44.185126 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: Python main interpreter initialized at 0x55833622d9c0 Sep 24 20:31:44.185788 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: python threads support enabled Sep 24 20:31:44.185788 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: your server socket listen backlog is limited to 100 connections Sep 24 20:31:44.185788 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: your mercy for graceful operations on workers is 90 seconds Sep 24 20:31:44.186052 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 20:31:44.186155 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: *** Operational MODE: preforking *** Sep 24 20:31:44.186415 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: *** uWSGI is running in multiple interpreter mode *** Sep 24 20:31:44.186415 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: spawned uWSGI master process (pid: 94866) Sep 24 20:31:44.186617 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Sep 24 20:31:44.187656 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: spawned uWSGI worker 1 (pid: 94879, cores: 1) Sep 24 20:31:44.187656 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: spawned uWSGI worker 2 (pid: 94880, cores: 1) Sep 24 20:31:44.187656 dv-osbrick-master-4-ceph devstack@keystone.service[94866]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 20:31:48.805559 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 20:31:48.805559 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: from cryptography.utils import int_from_bytes Sep 24 20:31:48.806400 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 20:31:48.806400 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: from cryptography.utils import int_from_bytes Sep 24 20:31:48.806837 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 20:31:48.806837 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: from cryptography.utils import int_from_bytes Sep 24 20:31:48.806969 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 20:31:48.806969 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: from cryptography.utils import int_from_bytes Sep 24 20:31:48.856428 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 20:31:48.856602 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 20:31:48.856690 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 20:31:48.856777 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 20:31:48.857360 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] command line args: [] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 20:31:48.857440 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] command line args: [] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 20:31:48.857581 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 20:31:48.857667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 20:31:48.857745 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ================================================================================ {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 20:31:48.857816 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ================================================================================ {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 20:31:48.858003 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] admin_token = **** {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.858090 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] admin_token = **** {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.858247 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] config_dir = [] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.858324 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] config_dir = [] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.858442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.858573 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.858661 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] config_source = [] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.858748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] config_source = [] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.858838 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] debug = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.858911 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] debug = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.858989 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.859258 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.859354 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.859420 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.859483 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] insecure_debug = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.859546 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] insecure_debug = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.859741 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.859834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.859991 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.860074 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.860221 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] list_limit = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.860303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] list_limit = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.860440 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] log_config_append = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.860527 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] log_config_append = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.860594 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.860659 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.860775 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] log_dir = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.860853 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] log_dir = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.860918 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] log_file = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.860987 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] log_file = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.861158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.861242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.861407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.861494 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.861653 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.861745 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.861900 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.861985 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.862067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.862140 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.862258 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.862373 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.862491 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.862594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.862738 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.862850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.862975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.863057 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.863206 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.863286 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.863440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.863521 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.863673 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.863745 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.863920 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.864001 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.864169 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] notification_format = cadf {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.864243 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] notification_format = cadf {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.864474 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.864555 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.864964 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.865042 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.865169 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] publish_errors = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.865244 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] publish_errors = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.865363 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.865437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.865588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.865667 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.865765 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.865839 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.866016 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.866114 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.866238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.866312 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.866473 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] standard_threads = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.866549 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] standard_threads = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.866705 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] strict_password_check = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.866780 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] strict_password_check = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.866948 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.867022 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.867124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] use_eventlog = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.867199 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] use_eventlog = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.867330 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] use_journal = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.867404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] use_journal = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.867474 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] use_json = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.867543 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] use_json = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.867610 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] use_stderr = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.868075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] use_stderr = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.868163 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] use_syslog = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.868250 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] use_syslog = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.868322 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] watch_log_file = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.868438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] watch_log_file = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 20:31:48.868511 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.868580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.868658 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.868729 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.868804 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.868912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.869014 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.869114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.869217 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.869313 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.869441 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.869549 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.869798 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.869933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.869933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.870076 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.870152 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.870223 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.870398 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.870475 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.870649 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.870732 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.870883 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.870960 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.871130 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.871210 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.871368 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.871444 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.871614 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.871690 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.871863 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.871945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.872103 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.872179 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.872374 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.872477 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.873166 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.873239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.873418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.873499 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.873657 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.873732 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.873911 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.873985 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.874176 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.874261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.874433 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.874511 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.874685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.874768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.874915 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.874990 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.875148 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.875229 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.875378 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.875465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.875623 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.875705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.875859 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.875936 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.876108 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.876199 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.876355 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.876437 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.876592 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.876678 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.876842 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.876928 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.877089 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.877165 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.877329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.877409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.877577 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.877659 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.877811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.877891 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.878045 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.878125 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.878282 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.878365 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.878512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.878586 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.878744 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.878824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.878974 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.879120 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.879194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.879262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.879429 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.879504 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.879681 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.879765 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.879911 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.879986 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.880149 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.880236 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.880401 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.880534 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.880644 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.880775 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.880885 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.881012 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.881138 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.881263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.881372 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.881495 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.881613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.881735 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.881853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.881973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.882091 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.882211 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.882320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.882448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.882555 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.882686 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.882787 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.882917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.883152 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.883274 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.883401 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.883514 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.883644 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.883754 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.883889 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.883984 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.884156 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.884247 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.884424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.884509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.884664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.884741 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.884909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.884985 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.885150 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.885230 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.885433 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.885509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.885677 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.885759 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.885929 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.886013 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.886179 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.886256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.886418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.886494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.886657 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.886736 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.886894 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.886978 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.887143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.enabled = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.887222 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.enabled = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.887385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.887470 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.887625 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.887701 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.887868 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.887952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.888134 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.888212 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.888413 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.888496 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.888656 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.888732 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.888893 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.888972 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.889129 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.889205 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.889367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.889444 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.889604 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.889681 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.889867 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.889946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.890112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.890191 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.890362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.890439 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.890606 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.890690 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.890847 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.890922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.891091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.891169 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.891329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.891405 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.891567 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.891655 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.891806 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.891891 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.892036 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.892112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.892270 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.892387 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.892526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.892615 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.892764 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.892840 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.892995 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.893070 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.893235 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.893321 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.893469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.893551 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.893719 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.893796 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.893958 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.894042 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.894214 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.894290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.894474 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.894550 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.894719 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.894825 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.894951 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] auth.external = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.895036 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] auth.external = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.895187 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] auth.mapped = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.895298 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] auth.mapped = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.895482 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.895574 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.895715 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.895813 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.895944 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] auth.password = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.896044 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] auth.password = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.896174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] auth.token = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.896260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] auth.token = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.896440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.896540 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.896677 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] catalog.caching = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.896763 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] catalog.caching = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.896924 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.897010 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.897157 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.897255 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.897405 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.897492 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.897653 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.897741 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.897885 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.897978 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.898118 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] credential.caching = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.898204 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] credential.caching = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.898368 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] credential.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.898455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] credential.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.898619 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.898713 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.898867 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.898961 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.899122 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.899208 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.899366 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.899460 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.899601 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.899687 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.899847 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.899933 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.900102 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.900197 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.900359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.900454 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.900617 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.900705 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.900903 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.901001 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.901149 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.901241 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.901416 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.901502 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.901661 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.901756 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.901920 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.902006 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.902156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] federation.caching = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.902241 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] federation.caching = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.902395 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.902601 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.902689 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] federation.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.902762 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] federation.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.902882 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.902979 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.903114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.903202 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.903365 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.903444 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.903605 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.903682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.903891 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.903972 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.904131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.904214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.904412 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.904492 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.904660 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.904740 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.904908 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.904985 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.905145 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity.caching = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.905221 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity.caching = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.905398 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.905478 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.905649 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.905727 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.905887 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.905964 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.906124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.906203 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.906373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.906456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.906606 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.906690 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.906844 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.906922 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.907096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.907174 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.907350 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.907429 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.907582 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.907664 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.907811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.907889 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.908042 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.908118 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.908287 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.908419 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.908563 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.908641 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.908812 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.908888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.909070 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.909149 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.909316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.909393 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.909585 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.909662 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.909825 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.909903 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.910083 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.910161 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.910293 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.910370 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.910533 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.910611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.910762 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.910839 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.910999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.911075 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.911237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.911315 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.911477 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.911553 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.911723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.911799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.911955 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.912032 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.912202 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.912279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.912475 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.912555 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.912711 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.912791 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.912961 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.913115 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.913259 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.913395 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.913537 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.913672 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.913805 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.914012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.914094 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.password = **** {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.914165 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.password = **** {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.914227 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.914285 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.914343 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.914414 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.914558 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.914634 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.914836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.914996 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.915105 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.915184 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.915256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.915338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.915512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.915641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.915792 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.915929 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.916011 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.916083 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.916299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.916455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.916573 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.916651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.916723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.916851 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.916923 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.917108 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.917227 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.917582 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.917662 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.917835 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.917994 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.918100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.918279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.918362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.918514 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.918645 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.918814 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.918897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.919054 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.919145 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.919207 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.919275 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.919949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.920102 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.920218 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.920291 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.920495 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.920584 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.920736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.920982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.921057 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.921217 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.921401 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.921477 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.921703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.921853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.921952 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.922201 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.922267 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.922435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.922686 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.922753 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.922926 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.923087 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.923355 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.923681 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.924069 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.924313 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.924420 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.924609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.924840 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.924938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.925132 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.925280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.925412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.925675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.925762 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.925949 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] policy.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.926150 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.926228 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.926443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.926606 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.926687 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.927006 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.927279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.927535 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.927830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] receipt.caching = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.927909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] policy.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.928113 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.928319 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.928442 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.928672 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.928836 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.928914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.929156 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.929312 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.929413 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] receipt.caching = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.929491 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] resource.caching = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.929664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.929743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.929926 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] resource.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.930012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.930175 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.930253 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.930415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.930492 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.930661 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.930751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.930910 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] resource.caching = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.930988 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] revoke.caching = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.931162 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.931239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.931420 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.931508 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] resource.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.931648 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.931724 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] role.cache_time = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.931886 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] role.caching = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.931962 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.932144 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] role.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.932298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.932396 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] role.list_limit = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.932470 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] revoke.caching = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.932653 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.932741 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.932896 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.932975 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.933144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] role.cache_time = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.933223 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.933386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] role.caching = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.933463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.933638 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.933716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] role.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.933872 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] role.list_limit = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.933951 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.934128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.934206 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.934380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.934459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.934620 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.934698 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.934872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.934949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.935685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.935819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.935938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.936018 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.936189 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.936267 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.936469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.936639 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.936718 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.937120 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.937216 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.937290 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.937378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.937454 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.937526 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.937625 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.937734 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.937880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.938119 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.938198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.938381 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.938460 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.938633 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.938710 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.938875 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.938954 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.939110 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.939188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.939346 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.939436 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.939581 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.939660 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.939837 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.939916 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.940095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.940180 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.940359 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.940442 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.940598 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.940677 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.940835 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.940959 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.941075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.941202 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] token.cache_time = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.941294 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] token.caching = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.941366 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.941524 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.941613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.941779 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] token.provider = fernet {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.941858 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.942022 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.942100 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.942262 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.942346 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.942499 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] token.cache_time = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.942577 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.942741 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] token.caching = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.942819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.942985 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.943071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.943229 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.943306 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] token.provider = fernet {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.943471 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.943548 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] trust.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.943710 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.943795 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.943953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.944031 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.944192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.944269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.944463 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.944555 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.944714 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.944792 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.944969 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] trust.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.945047 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.945213 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.945302 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.945465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.945577 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.945704 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.945787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.connection = **** {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.945957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.946036 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.946218 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.946298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.946464 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.946543 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.946709 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.946797 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.946946 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.947025 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.947189 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.947269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.connection = **** {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.947429 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.947507 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.947670 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.947749 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.947920 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.948001 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.948160 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.948238 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.948424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.948506 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.948663 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.948743 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.948908 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.948986 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.949145 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.949222 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.949391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.949471 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.949623 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.949702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.949865 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.949944 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.950102 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.950182 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.950276 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94879) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 20:31:48.950355 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.950621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.950856 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.951092 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.951339 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.951580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 20:31:48.951752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=94880) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 20:31:48.979719 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:48.979945 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:48.980175 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:48.985886 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:48.986123 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:48.986350 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:48.989253 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:48.995074 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.017103 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.017333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.021326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.021562 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.070889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.071167 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.119349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.119581 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.120363 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.120591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.185939 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.186175 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.186405 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.186543 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.186699 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.186837 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.186968 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.187111 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.187246 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.187333 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.187409 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.187609 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.210248 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.210481 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.210570 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.210706 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.210791 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.210925 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.211026 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.211140 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.211226 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.211353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.211438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.211566 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.211651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.211834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.223128 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.223552 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.235550 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.235788 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.235965 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.236053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.236200 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.236302 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.236447 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.236533 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.236663 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.236748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.236877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94879) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.236975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.237090 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.237306 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=94880) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 20:31:49.254052 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.254270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 20:31:49.254442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.254614 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.254701 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 20:31:49.254817 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 20:31:49.254993 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.255097 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.255188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 20:31:49.255366 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.255455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.255630 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.255777 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.255917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.256049 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.256217 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.265564 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.265849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.265933 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.266125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.266209 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.266415 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.266499 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.266740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.273410 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.273781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.276315 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.276623 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.276706 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.276911 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.276994 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.277198 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.277280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.277484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.277565 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.277750 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.277834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.278020 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.278102 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.278297 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.278388 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.278569 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.278650 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.279364 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.279444 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.279636 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.279718 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.279908 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.304092 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.304510 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.305586 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.305878 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.305992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.306283 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.310480 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.310770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.310905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.311198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.312679 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.313136 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.319197 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.319490 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.319656 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.319948 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.323582 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.323840 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.324020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.324127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.324349 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.324532 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.324642 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.324815 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.325040 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.325119 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.325325 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.325413 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.325634 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.325723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.325925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.326223 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.341919 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.342201 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.343147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.343445 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.346095 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.347370 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.349244 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.349658 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.350541 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.350957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.353909 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.355221 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.357128 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.358471 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.360244 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.360648 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.360939 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.361347 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.361621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.361704 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.361920 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.362001 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.362212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.362620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.362918 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.363209 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.378332 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.378626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.378901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.379171 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.379677 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.379969 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.380239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.380539 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.385970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.387376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.387620 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.389127 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.389281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.389563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.390695 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.390979 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.392218 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.392532 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.392821 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.393118 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.393405 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.393655 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.393954 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.394259 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.394548 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.394828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.405288 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.405577 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.405864 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.406151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.406442 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.406725 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.406900 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.407020 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.407220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.407512 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.407809 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.408147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.408498 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.408807 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.423494 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.425281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.426540 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.428324 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.429467 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.430905 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.431263 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.432385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.432675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.432773 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.432985 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.434190 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.434494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.434799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.439508 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.441015 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.441384 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.442879 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.443886 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.444191 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.444504 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.444787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.445829 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.446127 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.446428 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.446708 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.452940 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.453238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.453523 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.454846 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.455128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.455415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.461358 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=94879) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.461645 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.461929 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.462209 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.462487 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.462772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.463048 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.463276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=94880) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 20:31:49.463358 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.463567 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.463657 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.463856 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.463945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.464136 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.464265 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.464431 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.464514 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.464701 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.464782 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.464965 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=94879) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.465047 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.465248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.465531 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.465817 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.466109 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.466922 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.467195 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.467465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=94880) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 20:31:49.500661 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55833622d9c0 pid: 94879 (default app) Sep 24 20:31:49.501204 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55833622d9c0 pid: 94880 (default app) Sep 24 20:31:49.504047 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b00e20-ca34-4565-896a-0189954beddb None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:31:49.504366 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b00e20-ca34-4565-896a-0189954beddb None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:31:49.504653 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b00e20-ca34-4565-896a-0189954beddb None None] PATH_INFO: `/v3` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:31:49.508804 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 791 bytes} [Sat Sep 24 20:31:49 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:31:56.746519 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1210169-0c58-484b-91d1-d52698b4a74f None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:31:56.747132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1210169-0c58-484b-91d1-d52698b4a74f None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:31:56.747132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1210169-0c58-484b-91d1-d52698b4a74f None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:31:56.751951 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:31:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:31:56.757639 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fececa7-6dbb-4822-bf13-95d5cfb939e6 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:31:56.758249 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fececa7-6dbb-4822-bf13-95d5cfb939e6 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:31:56.758249 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fececa7-6dbb-4822-bf13-95d5cfb939e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:31:56.839856 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: INFO dbcounter [None req-0fececa7-6dbb-4822-bf13-95d5cfb939e6 None None] Registered counter for database keystone Sep 24 20:31:56.859056 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG oslo_db.sqlalchemy.engines [None req-0fececa7-6dbb-4822-bf13-95d5cfb939e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94879) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:31:56.865265 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writer thread running {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:31:57.042997 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG passlib.handlers.bcrypt [None req-0fececa7-6dbb-4822-bf13-95d5cfb939e6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=94879) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 24 20:31:57.043274 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG passlib.handlers.bcrypt [None req-0fececa7-6dbb-4822-bf13-95d5cfb939e6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=94879) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 24 20:31:57.100935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-0fececa7-6dbb-4822-bf13-95d5cfb939e6 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:31:57.102528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-0fececa7-6dbb-4822-bf13-95d5cfb939e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:31:57.231316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:31:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 24 20:31:57.721295 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1210169-0c58-484b-91d1-d52698b4a74f None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:31:57.797629 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: INFO dbcounter [None req-c1210169-0c58-484b-91d1-d52698b4a74f None None] Registered counter for database keystone Sep 24 20:31:57.818801 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG oslo_db.sqlalchemy.engines [None req-c1210169-0c58-484b-91d1-d52698b4a74f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94880) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 20:31:57.825102 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writer thread running {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 20:31:57.942774 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1210169-0c58-484b-91d1-d52698b4a74f None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:31:57.947084 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4beebd-cd8e-4926-863c-edad22bbb78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:31:57.947705 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4beebd-cd8e-4926-863c-edad22bbb78f admin admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:31:57.947988 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4beebd-cd8e-4926-863c-edad22bbb78f admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:31:57.948263 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4beebd-cd8e-4926-863c-edad22bbb78f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:31:57.957017 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4beebd-cd8e-4926-863c-edad22bbb78f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:31:58.007823 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2c4beebd-cd8e-4926-863c-edad22bbb78f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 24 20:31:58.008119 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4beebd-cd8e-4926-863c-edad22bbb78f admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:31:58.017938 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1324 bytes} [Sat Sep 24 20:31:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 20:31:58.023842 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fececa7-6dbb-4822-bf13-95d5cfb939e6 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:31:58.041062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fececa7-6dbb-4822-bf13-95d5cfb939e6 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:31:58.045937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fbd71-4585-49ec-b5c8-b1e844576e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:31:58.047038 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fbd71-4585-49ec-b5c8-b1e844576e63 admin admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:31:58.047319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fbd71-4585-49ec-b5c8-b1e844576e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:31:58.047593 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fbd71-4585-49ec-b5c8-b1e844576e63 admin admin] PATH_INFO: `/v3/projects/e9733fd590bc408aa51b7edd8cdd8117` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:31:58.051357 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fbd71-4585-49ec-b5c8-b1e844576e63 admin admin] RBAC: Authorizing `identity:get_project(project_id=e9733fd590bc408aa51b7edd8cdd8117)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:31:58.101940 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: WARNING keystone.common.rbac_enforcer.enforcer [None req-139fbd71-4585-49ec-b5c8-b1e844576e63 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 24 20:31:58.102286 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fbd71-4585-49ec-b5c8-b1e844576e63 admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:31:58.106786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 3/5] 10.222.0.61 () {56 vars in 1207 bytes} [Sat Sep 24 20:31:58 2022] GET /identity/v3/projects/e9733fd590bc408aa51b7edd8cdd8117 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:00.465375 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34878-0c6b-4aba-92b2-bdcfbe0c0442 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:00.466487 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34878-0c6b-4aba-92b2-bdcfbe0c0442 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:00.466487 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc34878-0c6b-4aba-92b2-bdcfbe0c0442 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:00.470521 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 3/6] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:00.476053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3798886-d91f-4483-9291-87c8c97f4acc None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:00.476449 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3798886-d91f-4483-9291-87c8c97f4acc None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:00.476634 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3798886-d91f-4483-9291-87c8c97f4acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:00.497231 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-f3798886-d91f-4483-9291-87c8c97f4acc None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:00.498761 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-f3798886-d91f-4483-9291-87c8c97f4acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:00.506718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 24 20:32:00.823857 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc34878-0c6b-4aba-92b2-bdcfbe0c0442 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:00.836720 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc34878-0c6b-4aba-92b2-bdcfbe0c0442 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:00.841559 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf0f34-70ee-4784-8cca-5474436d245a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:00.842152 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf0f34-70ee-4784-8cca-5474436d245a admin admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:00.842433 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf0f34-70ee-4784-8cca-5474436d245a admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:00.842707 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf0f34-70ee-4784-8cca-5474436d245a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:00.850255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf0f34-70ee-4784-8cca-5474436d245a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:00.852005 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf0f34-70ee-4784-8cca-5474436d245a admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:00.861182 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1324 bytes} [Sat Sep 24 20:32:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 20:32:00.866394 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3798886-d91f-4483-9291-87c8c97f4acc None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:00.875600 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3798886-d91f-4483-9291-87c8c97f4acc None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:00.880258 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa3bc5-4e94-4b95-a7ce-553d40654486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:00.880985 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa3bc5-4e94-4b95-a7ce-553d40654486 admin admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:00.881269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa3bc5-4e94-4b95-a7ce-553d40654486 admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:00.881546 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa3bc5-4e94-4b95-a7ce-553d40654486 admin admin] PATH_INFO: `/v3/users/9f6d7830fd8e4f16950273e6f89f703c` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:00.882858 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa3bc5-4e94-4b95-a7ce-553d40654486 admin admin] RBAC: Authorizing `identity:get_user(user_id=9f6d7830fd8e4f16950273e6f89f703c)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:00.884757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa3bc5-4e94-4b95-a7ce-553d40654486 admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:00.886262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 5/9] 10.222.0.61 () {56 vars in 1198 bytes} [Sat Sep 24 20:32:00 2022] GET /identity/v3/users/9f6d7830fd8e4f16950273e6f89f703c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:03.344083 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427c4b4-4704-4238-8e59-a5952c01712b None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:03.344658 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427c4b4-4704-4238-8e59-a5952c01712b None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:03.344872 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427c4b4-4704-4238-8e59-a5952c01712b None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:03.346796 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:03.352210 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c83d9-bdbe-41ca-aecb-b9d030d0fea1 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:03.352657 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c83d9-bdbe-41ca-aecb-b9d030d0fea1 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:03.352806 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c83d9-bdbe-41ca-aecb-b9d030d0fea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:03.370853 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-ec5c83d9-bdbe-41ca-aecb-b9d030d0fea1 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:03.372065 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-ec5c83d9-bdbe-41ca-aecb-b9d030d0fea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:03.407376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772b773-1e22-45d6-a095-d770e373f37d None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:03.407663 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772b773-1e22-45d6-a095-d770e373f37d None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:03.407944 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772b773-1e22-45d6-a095-d770e373f37d None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:03.411136 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 6/11] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:32:03.416848 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768098f8-39ac-40cd-8f88-0dbb7c1b76af None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:03.417474 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768098f8-39ac-40cd-8f88-0dbb7c1b76af None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:03.417666 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768098f8-39ac-40cd-8f88-0dbb7c1b76af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:03.459403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:03.463232 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG passlib.handlers.bcrypt [None req-768098f8-39ac-40cd-8f88-0dbb7c1b76af None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=94880) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 24 20:32:03.463622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG passlib.handlers.bcrypt [None req-768098f8-39ac-40cd-8f88-0dbb7c1b76af None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=94880) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 24 20:32:03.514968 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-768098f8-39ac-40cd-8f88-0dbb7c1b76af None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:03.517212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-768098f8-39ac-40cd-8f88-0dbb7c1b76af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:03.622356 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:32:03.778535 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c83d9-bdbe-41ca-aecb-b9d030d0fea1 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:03.803417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:03.947015 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768098f8-39ac-40cd-8f88-0dbb7c1b76af None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:04.000417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c83d9-bdbe-41ca-aecb-b9d030d0fea1 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:04.035279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b4e9a-772a-4a63-a062-99e1713717af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:04.035848 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b4e9a-772a-4a63-a062-99e1713717af None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:04.036131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b4e9a-772a-4a63-a062-99e1713717af None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:04.036451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b4e9a-772a-4a63-a062-99e1713717af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:04.047920 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b4e9a-772a-4a63-a062-99e1713717af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:04.048303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768098f8-39ac-40cd-8f88-0dbb7c1b76af None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:04.050669 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:04.056850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-242b4e9a-772a-4a63-a062-99e1713717af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:04.056850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:04.056850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:04.056850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:04.056850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:04.056850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:04.056850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:04.056850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:04.056850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:04.056850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:04.056850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:04.056850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:04.056850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:04.056850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:04.056850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:04.056850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:04.057841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:04.057841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:04.057841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:04.057841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:04.057841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:04.057841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:04.057841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:04.057841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:04.057841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:04.057841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:04.057841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:04.057841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:04.057841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:04.057841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:04.057841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:04.057841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:04.058693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:04.058693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:04.058693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:04.058693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:04.058693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:04.058693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:04.058693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:04.058693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:04.058693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:04.058693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:04.058693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:04.058693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:04.058693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 7/14] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:32:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:04.063929 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b4e9a-772a-4a63-a062-99e1713717af None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:04.088768 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4255020-041f-44e2-96d7-1cfecc5ec7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:04.089645 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4255020-041f-44e2-96d7-1cfecc5ec7f0 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:04.089934 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4255020-041f-44e2-96d7-1cfecc5ec7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:04.090211 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4255020-041f-44e2-96d7-1cfecc5ec7f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:04.145793 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:04.158135 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4255020-041f-44e2-96d7-1cfecc5ec7f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:04.158307 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4255020-041f-44e2-96d7-1cfecc5ec7f0 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:04.165099 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b4e9a-772a-4a63-a062-99e1713717af None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:04.204415 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af2439-9fb8-459d-be32-2b1e6bc2cafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:04.205070 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af2439-9fb8-459d-be32-2b1e6bc2cafb None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:04.205350 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af2439-9fb8-459d-be32-2b1e6bc2cafb None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:04.205624 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af2439-9fb8-459d-be32-2b1e6bc2cafb None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:04.206284 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af2439-9fb8-459d-be32-2b1e6bc2cafb None admin] RBAC: Adding query filter params (name=admin) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:04.206656 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af2439-9fb8-459d-be32-2b1e6bc2cafb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:04.207963 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af2439-9fb8-459d-be32-2b1e6bc2cafb None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:04.219986 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 8/15] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:04.225751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af2439-9fb8-459d-be32-2b1e6bc2cafb None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:04.259888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 8/16] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 20:32:04.265401 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4255020-041f-44e2-96d7-1cfecc5ec7f0 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:04.268059 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:04.323521 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af2439-9fb8-459d-be32-2b1e6bc2cafb None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:04.357700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0063fb-daf6-481c-8ca0-22ddc34ae887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:04.358336 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0063fb-daf6-481c-8ca0-22ddc34ae887 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:04.358619 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0063fb-daf6-481c-8ca0-22ddc34ae887 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:04.358889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0063fb-daf6-481c-8ca0-22ddc34ae887 None admin] PATH_INFO: `/v3/users/9f6d7830fd8e4f16950273e6f89f703c` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:04.360021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0063fb-daf6-481c-8ca0-22ddc34ae887 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6d7830fd8e4f16950273e6f89f703c)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:04.361506 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0063fb-daf6-481c-8ca0-22ddc34ae887 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:04.362018 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4255020-041f-44e2-96d7-1cfecc5ec7f0 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:04.363061 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 9/17] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:04 2022] GET /identity/v3/users/9f6d7830fd8e4f16950273e6f89f703c => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:04.368549 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0063fb-daf6-481c-8ca0-22ddc34ae887 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:04.383208 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:04.395384 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca92d2-b7b0-4984-b7db-a89927d955cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:04.396249 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca92d2-b7b0-4984-b7db-a89927d955cd None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:04.396570 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca92d2-b7b0-4984-b7db-a89927d955cd None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:04.396851 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca92d2-b7b0-4984-b7db-a89927d955cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:04.415718 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca92d2-b7b0-4984-b7db-a89927d955cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:04.417457 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca92d2-b7b0-4984-b7db-a89927d955cd None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:04.437797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-53ca92d2-b7b0-4984-b7db-a89927d955cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:32:04.437797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:04.437797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:04.437797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:04.437797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:04.437797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:04.437797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:04.437797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:04.437797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:04.437797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:04.437797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:04.437797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:04.437797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:32:04.437797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:32:04.437797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:32:04.437797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:04.438888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:32:04.439921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:32:04.439921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:32:04.439921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:04.439921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 9/18] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:32:04.444717 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca92d2-b7b0-4984-b7db-a89927d955cd None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:04.474312 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0063fb-daf6-481c-8ca0-22ddc34ae887 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:04.511204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd4b13-7b63-44b4-966b-11e9fbaa969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:04.511860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd4b13-7b63-44b4-966b-11e9fbaa969c None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:04.512145 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd4b13-7b63-44b4-966b-11e9fbaa969c None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:04.512464 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd4b13-7b63-44b4-966b-11e9fbaa969c None admin] PATH_INFO: `/v3/domains/default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:04.514175 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd4b13-7b63-44b4-966b-11e9fbaa969c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:04.515662 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd4b13-7b63-44b4-966b-11e9fbaa969c None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:04.517286 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 10/19] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:04.523269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd4b13-7b63-44b4-966b-11e9fbaa969c None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:04.607643 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:04.609799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:04.627709 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd4b13-7b63-44b4-966b-11e9fbaa969c None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:04.653866 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca92d2-b7b0-4984-b7db-a89927d955cd None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:04.661360 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2c316-dcc8-40c2-9211-e3241b444e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:04.661963 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2c316-dcc8-40c2-9211-e3241b444e6f None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:04.662254 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2c316-dcc8-40c2-9211-e3241b444e6f None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:04.662527 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2c316-dcc8-40c2-9211-e3241b444e6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:04.663242 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2c316-dcc8-40c2-9211-e3241b444e6f None admin] RBAC: Adding query filter params (role.id=9cc90aa0ccde4b75b7642101cbf45cf2, scope.domain.id=default, user.id=9f6d7830fd8e4f16950273e6f89f703c) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:04.663555 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2c316-dcc8-40c2-9211-e3241b444e6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:04.665018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2c316-dcc8-40c2-9211-e3241b444e6f None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:04.672172 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 11/20] 10.222.0.61 () {56 vars in 1322 bytes} [Sat Sep 24 20:32:04 2022] GET /identity/v3/role_assignments?user.id=9f6d7830fd8e4f16950273e6f89f703c&scope.domain.id=default&role.id=9cc90aa0ccde4b75b7642101cbf45cf2 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:04.687704 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5359a7-46ef-4bec-980c-f0569748aa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:04.688328 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5359a7-46ef-4bec-980c-f0569748aa43 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:04.688627 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5359a7-46ef-4bec-980c-f0569748aa43 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:04.688902 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5359a7-46ef-4bec-980c-f0569748aa43 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:04.689560 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5359a7-46ef-4bec-980c-f0569748aa43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:04.689866 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5359a7-46ef-4bec-980c-f0569748aa43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:04.691304 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5359a7-46ef-4bec-980c-f0569748aa43 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:04.711070 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 10/21] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:07.598923 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a67b9-8596-4217-918a-f22b719afaf3 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:07.599901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a67b9-8596-4217-918a-f22b719afaf3 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:07.600414 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a67b9-8596-4217-918a-f22b719afaf3 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:07.601944 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 12/22] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:07.607492 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e3fcf-201c-4bc2-9338-748fd1feeccc None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:07.608287 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e3fcf-201c-4bc2-9338-748fd1feeccc None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:07.608783 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e3fcf-201c-4bc2-9338-748fd1feeccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:07.634025 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-f78e3fcf-201c-4bc2-9338-748fd1feeccc None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:07.635579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-f78e3fcf-201c-4bc2-9338-748fd1feeccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:07.658355 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77978dc3-20e6-4a3e-8cbd-dc359cf89da1 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:07.658668 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77978dc3-20e6-4a3e-8cbd-dc359cf89da1 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:07.658916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77978dc3-20e6-4a3e-8cbd-dc359cf89da1 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:07.660232 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 13/23] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:32:07.676779 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82b8bf-e5b4-4981-8992-a7d2beeac286 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:07.677068 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82b8bf-e5b4-4981-8992-a7d2beeac286 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:07.677352 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af82b8bf-e5b4-4981-8992-a7d2beeac286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:07.715238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-af82b8bf-e5b4-4981-8992-a7d2beeac286 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:07.716558 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-af82b8bf-e5b4-4981-8992-a7d2beeac286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:07.735391 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 11/24] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:07.736699 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de7089-d58f-44d1-a6fd-ba404941b65a None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:07.736988 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de7089-d58f-44d1-a6fd-ba404941b65a None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:07.737267 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de7089-d58f-44d1-a6fd-ba404941b65a None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:07.738716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 12/25] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:07.744240 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe3efd-6818-4224-ab72-bbbbbe36f660 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:07.744766 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe3efd-6818-4224-ab72-bbbbbe36f660 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:07.745188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe3efd-6818-4224-ab72-bbbbbe36f660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:07.773845 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-8ffe3efd-6818-4224-ab72-bbbbbe36f660 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:07.775249 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-8ffe3efd-6818-4224-ab72-bbbbbe36f660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:07.869127 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:07.873738 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 14/26] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:32:07.906061 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 13/27] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:08.156232 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82b8bf-e5b4-4981-8992-a7d2beeac286 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:08.194740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c47191-9c62-4655-8406-07ede2c4c02b None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:08.195031 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c47191-9c62-4655-8406-07ede2c4c02b None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:08.195312 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c47191-9c62-4655-8406-07ede2c4c02b None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:08.196671 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 14/28] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:08.221386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448bb35-976b-4d5f-92db-95ee9ac97842 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:08.221677 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448bb35-976b-4d5f-92db-95ee9ac97842 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:08.221961 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448bb35-976b-4d5f-92db-95ee9ac97842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:08.265570 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-c448bb35-976b-4d5f-92db-95ee9ac97842 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:08.266776 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-c448bb35-976b-4d5f-92db-95ee9ac97842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:08.285549 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:08.329271 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af82b8bf-e5b4-4981-8992-a7d2beeac286 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:08.391442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 15/29] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:32:08.392685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448bb35-976b-4d5f-92db-95ee9ac97842 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:08.405038 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82064e11-3491-4e34-b01e-8c67d2412f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:08.405997 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82064e11-3491-4e34-b01e-8c67d2412f44 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:08.406562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82064e11-3491-4e34-b01e-8c67d2412f44 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:08.407028 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82064e11-3491-4e34-b01e-8c67d2412f44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:08.437252 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82064e11-3491-4e34-b01e-8c67d2412f44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:08.442418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-82064e11-3491-4e34-b01e-8c67d2412f44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:08.442418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:08.442418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:08.442418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:08.442418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:08.442418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:08.442418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:08.442418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:08.442418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:08.442418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:08.442418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:08.442418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:08.442418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:08.442418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:08.442418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:08.442418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:08.443263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:08.443263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:08.443263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:08.443263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:08.443263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:08.443263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:08.443263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:08.443263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:08.443263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:08.443263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:08.443263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:08.443263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:08.443263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:08.443263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:08.443263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:08.443263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:08.444021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:08.444021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:08.444021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:08.444021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:08.444021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:08.444021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:08.444021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:08.444021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:08.444021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:08.444021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:08.444021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:08.444021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:08.452359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 15/30] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:32:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:08.453563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82064e11-3491-4e34-b01e-8c67d2412f44 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:08.504359 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448bb35-976b-4d5f-92db-95ee9ac97842 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:08.513070 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:08.565786 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0b795-656c-4e28-b281-bfd0ad60dbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:08.566727 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0b795-656c-4e28-b281-bfd0ad60dbd2 None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:08.567329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0b795-656c-4e28-b281-bfd0ad60dbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:08.568001 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0b795-656c-4e28-b281-bfd0ad60dbd2 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:08.569783 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0b795-656c-4e28-b281-bfd0ad60dbd2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:08.571518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0b795-656c-4e28-b281-bfd0ad60dbd2 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:08.671988 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82064e11-3491-4e34-b01e-8c67d2412f44 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:08.739787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2666-e5d0-4bc2-96b7-d1a2f8092e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:08.740449 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2666-e5d0-4bc2-96b7-d1a2f8092e92 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:08.740738 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2666-e5d0-4bc2-96b7-d1a2f8092e92 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:08.741019 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e2666-e5d0-4bc2-96b7-d1a2f8092e92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:08.748884 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:08.761856 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e2666-e5d0-4bc2-96b7-d1a2f8092e92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:08.764562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e2666-e5d0-4bc2-96b7-d1a2f8092e92 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:08.785304 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 16/31] 10.222.0.61 () {60 vars in 1131 bytes} [Sat Sep 24 20:32:08 2022] POST /identity/v3/roles => generated 219 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:32:08.786136 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0b795-656c-4e28-b281-bfd0ad60dbd2 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:08.790609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-b19e2666-e5d0-4bc2-96b7-d1a2f8092e92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:32:08.790609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:08.790609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:08.790609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:08.790609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:08.790609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:08.790609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:08.790609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:08.790609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:08.790609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:08.790609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:08.790609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:08.790609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:32:08.790609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:32:08.790609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:32:08.790609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:08.791691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:32:08.792941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:32:08.792941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:32:08.792941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:08.794499 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 16/32] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:08.800234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2666-e5d0-4bc2-96b7-d1a2f8092e92 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:09.004667 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e2666-e5d0-4bc2-96b7-d1a2f8092e92 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:09.013064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0b795-656c-4e28-b281-bfd0ad60dbd2 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:09.067919 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da38de4-8030-4228-9292-a1e5761c0572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:09.069148 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da38de4-8030-4228-9292-a1e5761c0572 None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:09.069436 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da38de4-8030-4228-9292-a1e5761c0572 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:09.069711 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da38de4-8030-4228-9292-a1e5761c0572 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:09.070402 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da38de4-8030-4228-9292-a1e5761c0572 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:09.072430 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da38de4-8030-4228-9292-a1e5761c0572 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:09.085299 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a20b22-2f96-4272-a395-cc8f3f9c5fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:09.086185 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a20b22-2f96-4272-a395-cc8f3f9c5fd4 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:09.086640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a20b22-2f96-4272-a395-cc8f3f9c5fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:09.086974 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a20b22-2f96-4272-a395-cc8f3f9c5fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:09.087688 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a20b22-2f96-4272-a395-cc8f3f9c5fd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:09.088226 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a20b22-2f96-4272-a395-cc8f3f9c5fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:09.089975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a20b22-2f96-4272-a395-cc8f3f9c5fd4 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:09.105532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 17/33] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:09.107200 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a20b22-2f96-4272-a395-cc8f3f9c5fd4 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:09.154576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:09.226894 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 17/34] 10.222.0.61 () {60 vars in 1131 bytes} [Sat Sep 24 20:32:08 2022] POST /identity/v3/roles => generated 225 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:32:09.228106 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da38de4-8030-4228-9292-a1e5761c0572 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:09.261161 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a20b22-2f96-4272-a395-cc8f3f9c5fd4 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:09.282757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:09.315192 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9bc18-d96c-4d7c-9961-e1efbbc17e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:09.316079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9bc18-d96c-4d7c-9961-e1efbbc17e26 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:09.316600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9bc18-d96c-4d7c-9961-e1efbbc17e26 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:09.317017 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9bc18-d96c-4d7c-9961-e1efbbc17e26 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:09.317891 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9bc18-d96c-4d7c-9961-e1efbbc17e26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:09.318342 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9bc18-d96c-4d7c-9961-e1efbbc17e26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:09.320667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9bc18-d96c-4d7c-9961-e1efbbc17e26 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:09.339711 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 18/35] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:09.348576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9bc18-d96c-4d7c-9961-e1efbbc17e26 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:09.354939 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da38de4-8030-4228-9292-a1e5761c0572 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:09.441249 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cb8a0-5694-491b-988d-312c5da1c920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:09.441974 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cb8a0-5694-491b-988d-312c5da1c920 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:09.442301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cb8a0-5694-491b-988d-312c5da1c920 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:09.442598 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cb8a0-5694-491b-988d-312c5da1c920 None admin] PATH_INFO: `/v3/users/9f6d7830fd8e4f16950273e6f89f703c` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:09.446109 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cb8a0-5694-491b-988d-312c5da1c920 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6d7830fd8e4f16950273e6f89f703c)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:09.447830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cb8a0-5694-491b-988d-312c5da1c920 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:09.452365 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 18/36] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:09 2022] GET /identity/v3/users/9f6d7830fd8e4f16950273e6f89f703c => generated 247 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:09.456212 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cb8a0-5694-491b-988d-312c5da1c920 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:09.515153 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:09.528810 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9bc18-d96c-4d7c-9961-e1efbbc17e26 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:09.578461 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135aedb6-6d4c-4e59-879c-21d10859ff71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:09.579091 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aedb6-6d4c-4e59-879c-21d10859ff71 None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:09.579383 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aedb6-6d4c-4e59-879c-21d10859ff71 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:09.579666 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aedb6-6d4c-4e59-879c-21d10859ff71 None admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:09.580613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135aedb6-6d4c-4e59-879c-21d10859ff71 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:09.582078 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135aedb6-6d4c-4e59-879c-21d10859ff71 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:09.592478 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cb8a0-5694-491b-988d-312c5da1c920 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:09.609213 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:09.617593 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 19/37] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Sep 24 20:32:09 2022] POST /identity/v3/projects => generated 301 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:32:09.618946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92731a97-7030-494f-9968-4c796036438c None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:09.619234 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92731a97-7030-494f-9968-4c796036438c None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:09.619510 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92731a97-7030-494f-9968-4c796036438c None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:09.620802 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 20/38] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:09.623789 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7a0f9-a053-44fa-baf5-3a590d744ca3 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:09.624088 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7a0f9-a053-44fa-baf5-3a590d744ca3 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:09.624394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7a0f9-a053-44fa-baf5-3a590d744ca3 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:09.626034 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 21/39] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:09.627416 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e44f54-a8e6-4299-bbdd-9f25e5f0960d None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:09.627711 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e44f54-a8e6-4299-bbdd-9f25e5f0960d None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:09.631794 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e44f54-a8e6-4299-bbdd-9f25e5f0960d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:09.641081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732f6d3-9e0b-471d-beed-9dce9e44c331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:09.641767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732f6d3-9e0b-471d-beed-9dce9e44c331 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:09.642048 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732f6d3-9e0b-471d-beed-9dce9e44c331 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:09.642322 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732f6d3-9e0b-471d-beed-9dce9e44c331 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:09.643594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732f6d3-9e0b-471d-beed-9dce9e44c331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:09.645120 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732f6d3-9e0b-471d-beed-9dce9e44c331 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:09.646949 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 19/40] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:09.648116 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf3a76-6c23-4a6f-ae50-2dc0831b9a20 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:09.648447 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf3a76-6c23-4a6f-ae50-2dc0831b9a20 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:09.648737 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf3a76-6c23-4a6f-ae50-2dc0831b9a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:09.654026 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-47e44f54-a8e6-4299-bbdd-9f25e5f0960d None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:09.656438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-47e44f54-a8e6-4299-bbdd-9f25e5f0960d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:09.670165 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-1aaf3a76-6c23-4a6f-ae50-2dc0831b9a20 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:09.671744 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-1aaf3a76-6c23-4a6f-ae50-2dc0831b9a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:09.742199 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 22/41] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:09.742876 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e44f54-a8e6-4299-bbdd-9f25e5f0960d None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:09.759783 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 20/42] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:09.828083 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:09.862758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e44f54-a8e6-4299-bbdd-9f25e5f0960d None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:09.905412 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cd29f-1f8e-48c2-b9f8-3b97a687556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:09.906091 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cd29f-1f8e-48c2-b9f8-3b97a687556f None admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:09.906379 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cd29f-1f8e-48c2-b9f8-3b97a687556f None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:09.906764 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cd29f-1f8e-48c2-b9f8-3b97a687556f None admin] PATH_INFO: `/v3/domains/default/users/9f6d7830fd8e4f16950273e6f89f703c/roles/9cc90aa0ccde4b75b7642101cbf45cf2` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:09.909097 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cd29f-1f8e-48c2-b9f8-3b97a687556f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9f6d7830fd8e4f16950273e6f89f703c, role_id=9cc90aa0ccde4b75b7642101cbf45cf2)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:09.910565 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cd29f-1f8e-48c2-b9f8-3b97a687556f None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:09.928183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 23/43] 10.222.0.61 () {58 vars in 1361 bytes} [Sat Sep 24 20:32:09 2022] PUT /identity/v3/domains/default/users/9f6d7830fd8e4f16950273e6f89f703c/roles/9cc90aa0ccde4b75b7642101cbf45cf2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:32:10.069064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf3a76-6c23-4a6f-ae50-2dc0831b9a20 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:10.104836 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cd29f-1f8e-48c2-b9f8-3b97a687556f None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:10.184516 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf3a76-6c23-4a6f-ae50-2dc0831b9a20 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:10.198663 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:10.221475 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cd29f-1f8e-48c2-b9f8-3b97a687556f None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:10.223324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906332a3-0b3e-425e-b588-c016012aa7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:10.224059 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906332a3-0b3e-425e-b588-c016012aa7ac None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:10.224367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906332a3-0b3e-425e-b588-c016012aa7ac None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:10.224654 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906332a3-0b3e-425e-b588-c016012aa7ac None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:10.225325 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906332a3-0b3e-425e-b588-c016012aa7ac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:10.226725 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906332a3-0b3e-425e-b588-c016012aa7ac None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:10.243215 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 21/44] 10.222.0.61 () {60 vars in 1131 bytes} [Sat Sep 24 20:32:10 2022] POST /identity/v3/roles => generated 223 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:32:10.252606 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:10.261007 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abe776-355e-448e-ba75-35469d65669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:10.262038 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abe776-355e-448e-ba75-35469d65669a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:10.262837 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abe776-355e-448e-ba75-35469d65669a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:10.263535 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abe776-355e-448e-ba75-35469d65669a None admin] PATH_INFO: `/v3/domains/default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:10.265313 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abe776-355e-448e-ba75-35469d65669a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:10.266813 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abe776-355e-448e-ba75-35469d65669a None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:10.268711 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 24/45] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:10.274223 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906332a3-0b3e-425e-b588-c016012aa7ac None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:10.384264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906332a3-0b3e-425e-b588-c016012aa7ac None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:10.422789 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d240f6-6080-4130-8ed5-027f8f10ae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:10.423417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d240f6-6080-4130-8ed5-027f8f10ae84 None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:10.423699 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d240f6-6080-4130-8ed5-027f8f10ae84 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:10.423972 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d240f6-6080-4130-8ed5-027f8f10ae84 None admin] PATH_INFO: `/v3/projects` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:10.424671 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d240f6-6080-4130-8ed5-027f8f10ae84 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:10.426127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d240f6-6080-4130-8ed5-027f8f10ae84 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:10.458841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 22/46] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Sep 24 20:32:10 2022] POST /identity/v3/projects => generated 312 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:32:12.333180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2867e-1c2e-4355-8ac4-f4cd45ebc6fa None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:12.333711 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2867e-1c2e-4355-8ac4-f4cd45ebc6fa None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:12.333856 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2867e-1c2e-4355-8ac4-f4cd45ebc6fa None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:12.335290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 25/47] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:12.340377 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44656811-39cd-4e31-8fd8-9a3953315d7e None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:12.340759 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44656811-39cd-4e31-8fd8-9a3953315d7e None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:12.340950 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44656811-39cd-4e31-8fd8-9a3953315d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:12.359292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-44656811-39cd-4e31-8fd8-9a3953315d7e None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:12.360476 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-44656811-39cd-4e31-8fd8-9a3953315d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:12.377531 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:12.427780 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 23/48] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:12.750588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2867e-1c2e-4355-8ac4-f4cd45ebc6fa None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:12.851885 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2867e-1c2e-4355-8ac4-f4cd45ebc6fa None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:12.861029 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8887102-a316-4717-89df-68f6483d8de2 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:12.861324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8887102-a316-4717-89df-68f6483d8de2 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:12.861598 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8887102-a316-4717-89df-68f6483d8de2 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:12.862929 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 24/49] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:12.867665 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdd04c-8a33-488e-8fbb-12232f5c8a99 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:12.867953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdd04c-8a33-488e-8fbb-12232f5c8a99 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:12.868238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bdd04c-8a33-488e-8fbb-12232f5c8a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:12.885284 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37c7c4-1fd1-4daf-8db6-eb3f2df90f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:12.885914 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37c7c4-1fd1-4daf-8db6-eb3f2df90f43 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:12.886010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-83bdd04c-8a33-488e-8fbb-12232f5c8a99 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:12.886200 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37c7c4-1fd1-4daf-8db6-eb3f2df90f43 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:12.886476 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37c7c4-1fd1-4daf-8db6-eb3f2df90f43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:12.887753 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-83bdd04c-8a33-488e-8fbb-12232f5c8a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:12.898660 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37c7c4-1fd1-4daf-8db6-eb3f2df90f43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:12.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-ec37c7c4-1fd1-4daf-8db6-eb3f2df90f43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:12.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:12.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:12.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:12.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:12.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:12.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:12.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:12.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:12.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:12.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:12.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:12.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:12.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:12.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:12.905352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:12.906276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:12.906276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:12.906276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:12.906276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:12.906276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:12.906276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:12.906276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:12.906276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:12.906276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:12.906276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:12.906276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:12.906276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:12.906276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:12.906276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:12.906276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:12.906276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:12.907020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:12.907020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:12.907020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:12.907020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:12.907020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:12.907020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:12.907020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:12.907020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:12.907020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:12.907020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:12.907020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:12.907020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:12.907020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 26/50] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:32:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:12.912098 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37c7c4-1fd1-4daf-8db6-eb3f2df90f43 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:12.963305 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 25/51] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:32:12.981043 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:13.021981 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37c7c4-1fd1-4daf-8db6-eb3f2df90f43 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:13.055617 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209dc08-bf82-47e9-b025-c2170e066c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:13.056222 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209dc08-bf82-47e9-b025-c2170e066c67 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:13.056545 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209dc08-bf82-47e9-b025-c2170e066c67 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:13.056821 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209dc08-bf82-47e9-b025-c2170e066c67 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:13.057472 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209dc08-bf82-47e9-b025-c2170e066c67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:13.057856 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209dc08-bf82-47e9-b025-c2170e066c67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:13.059238 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209dc08-bf82-47e9-b025-c2170e066c67 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:13.067095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 27/52] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:13.072716 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdd04c-8a33-488e-8fbb-12232f5c8a99 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:13.157051 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:13.175134 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bdd04c-8a33-488e-8fbb-12232f5c8a99 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:13.208640 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79ca6b-992f-4a3d-9ef1-f98b5baa129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:13.209269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79ca6b-992f-4a3d-9ef1-f98b5baa129d None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:13.209554 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79ca6b-992f-4a3d-9ef1-f98b5baa129d None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:13.209833 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79ca6b-992f-4a3d-9ef1-f98b5baa129d None admin] PATH_INFO: `/v3/users/9f6d7830fd8e4f16950273e6f89f703c` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:13.210955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79ca6b-992f-4a3d-9ef1-f98b5baa129d None admin] RBAC: Authorizing `identity:get_user(user_id=9f6d7830fd8e4f16950273e6f89f703c)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:13.212446 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79ca6b-992f-4a3d-9ef1-f98b5baa129d None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:13.214006 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:13 2022] GET /identity/v3/users/9f6d7830fd8e4f16950273e6f89f703c => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:13.220240 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209dc08-bf82-47e9-b025-c2170e066c67 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:13.294927 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79ca6b-992f-4a3d-9ef1-f98b5baa129d None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:13.318666 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209dc08-bf82-47e9-b025-c2170e066c67 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:13.338430 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:13.353814 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d93e5b-c6a6-44d3-ac71-a0e98a376c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:13.354495 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93e5b-c6a6-44d3-ac71-a0e98a376c10 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:13.354862 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93e5b-c6a6-44d3-ac71-a0e98a376c10 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:13.355243 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93e5b-c6a6-44d3-ac71-a0e98a376c10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:13.356297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d93e5b-c6a6-44d3-ac71-a0e98a376c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:13.357762 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d93e5b-c6a6-44d3-ac71-a0e98a376c10 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:13.359305 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 28/54] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:13.364981 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d93e5b-c6a6-44d3-ac71-a0e98a376c10 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:13.396593 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79ca6b-992f-4a3d-9ef1-f98b5baa129d None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:13.430342 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1030d-8786-4d06-81db-593a3fe38b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:13.430968 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1030d-8786-4d06-81db-593a3fe38b0d None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:13.431259 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1030d-8786-4d06-81db-593a3fe38b0d None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:13.431539 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1030d-8786-4d06-81db-593a3fe38b0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:13.432687 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1030d-8786-4d06-81db-593a3fe38b0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:13.434175 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1030d-8786-4d06-81db-593a3fe38b0d None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:13.435717 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:13.441118 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1030d-8786-4d06-81db-593a3fe38b0d None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:13.461682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:13.461870 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d93e5b-c6a6-44d3-ac71-a0e98a376c10 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:13.497280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972a644-d52a-483d-8d47-d86d8718bc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:13.498109 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972a644-d52a-483d-8d47-d86d8718bc95 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:13.498399 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972a644-d52a-483d-8d47-d86d8718bc95 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:13.498685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972a644-d52a-483d-8d47-d86d8718bc95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:13.499410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972a644-d52a-483d-8d47-d86d8718bc95 None admin] RBAC: Adding query filter params (role.id=9cc90aa0ccde4b75b7642101cbf45cf2, scope.domain.id=default, user.id=9f6d7830fd8e4f16950273e6f89f703c) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:13.499725 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972a644-d52a-483d-8d47-d86d8718bc95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:13.501191 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972a644-d52a-483d-8d47-d86d8718bc95 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:13.509109 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 29/56] 10.222.0.61 () {56 vars in 1322 bytes} [Sat Sep 24 20:32:13 2022] GET /identity/v3/role_assignments?user.id=9f6d7830fd8e4f16950273e6f89f703c&scope.domain.id=default&role.id=9cc90aa0ccde4b75b7642101cbf45cf2 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:13.544154 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1030d-8786-4d06-81db-593a3fe38b0d None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:13.581293 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b5b42-8bf6-46b9-a2bf-2735b571e9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:13.581835 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b5b42-8bf6-46b9-a2bf-2735b571e9e4 None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:13.582118 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b5b42-8bf6-46b9-a2bf-2735b571e9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:13.582390 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b5b42-8bf6-46b9-a2bf-2735b571e9e4 None admin] PATH_INFO: `/v3/projects` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:13.583053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b5b42-8bf6-46b9-a2bf-2735b571e9e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:13.584552 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b5b42-8bf6-46b9-a2bf-2735b571e9e4 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:13.613124 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 28/57] 10.222.0.61 () {60 vars in 1140 bytes} [Sat Sep 24 20:32:13 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:32:16.010718 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3795d6f-933f-4b15-afcb-bfd0e486302c None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:16.011262 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3795d6f-933f-4b15-afcb-bfd0e486302c None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:16.011262 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3795d6f-933f-4b15-afcb-bfd0e486302c None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:16.013149 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 30/58] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:16.018269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25462a0-1b1d-4607-a988-b90ecb70ce23 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:16.018636 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25462a0-1b1d-4607-a988-b90ecb70ce23 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:16.018831 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25462a0-1b1d-4607-a988-b90ecb70ce23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:16.037200 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-d25462a0-1b1d-4607-a988-b90ecb70ce23 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:16.038389 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-d25462a0-1b1d-4607-a988-b90ecb70ce23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:16.105435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 29/59] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:16.421055 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3795d6f-933f-4b15-afcb-bfd0e486302c None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:16.473287 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:16.519416 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3795d6f-933f-4b15-afcb-bfd0e486302c None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:16.552224 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16b985-2cc8-402d-bab5-befb70f39301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:16.552885 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16b985-2cc8-402d-bab5-befb70f39301 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:16.553166 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16b985-2cc8-402d-bab5-befb70f39301 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:16.553441 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16b985-2cc8-402d-bab5-befb70f39301 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:16.554541 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16b985-2cc8-402d-bab5-befb70f39301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:16.555983 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16b985-2cc8-402d-bab5-befb70f39301 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:16.557592 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 31/60] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:16.563180 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25462a0-1b1d-4607-a988-b90ecb70ce23 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:16.565389 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:16.660876 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25462a0-1b1d-4607-a988-b90ecb70ce23 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:16.694281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b722a-d71a-40c5-8813-029e2d9f4c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:16.694819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b722a-d71a-40c5-8813-029e2d9f4c38 None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:16.695098 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b722a-d71a-40c5-8813-029e2d9f4c38 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:16.695370 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b722a-d71a-40c5-8813-029e2d9f4c38 None admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:16.696012 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b722a-d71a-40c5-8813-029e2d9f4c38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:16.697472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b722a-d71a-40c5-8813-029e2d9f4c38 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:16.722935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 30/61] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Sep 24 20:32:16 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:32:20.216809 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa354f-1a7d-48de-82b7-03b972b2aa71 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:20.217800 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa354f-1a7d-48de-82b7-03b972b2aa71 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:20.218278 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa354f-1a7d-48de-82b7-03b972b2aa71 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:20.219824 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 32/62] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:20.225379 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a860-b173-4b5a-abb0-825fc7f92f30 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:20.225820 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a860-b173-4b5a-abb0-825fc7f92f30 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:20.225938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a860-b173-4b5a-abb0-825fc7f92f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:20.253352 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-22f4a860-b173-4b5a-abb0-825fc7f92f30 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:20.254839 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-22f4a860-b173-4b5a-abb0-825fc7f92f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:20.333655 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:20.354216 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 31/63] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:20.608699 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d46a5e-a52f-4b2b-b502-9cd1144bd958 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:20.609368 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d46a5e-a52f-4b2b-b502-9cd1144bd958 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:20.609858 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d46a5e-a52f-4b2b-b502-9cd1144bd958 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:20.611385 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 33/64] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:20.616740 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f211705-47d2-438d-9080-968d876d6db7 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:20.617038 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f211705-47d2-438d-9080-968d876d6db7 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:20.617319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f211705-47d2-438d-9080-968d876d6db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:20.646412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-7f211705-47d2-438d-9080-968d876d6db7 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:20.647646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-7f211705-47d2-438d-9080-968d876d6db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:20.666048 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e1281-03e2-48e9-b58b-f550e6a6d4ca None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:20.666692 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e1281-03e2-48e9-b58b-f550e6a6d4ca None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:20.667426 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e1281-03e2-48e9-b58b-f550e6a6d4ca None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:20.669618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 34/65] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:20.675342 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66c830-7f98-4451-8672-18f20e258bb7 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:20.675945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66c830-7f98-4451-8672-18f20e258bb7 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:20.676482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66c830-7f98-4451-8672-18f20e258bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:20.703079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-3e66c830-7f98-4451-8672-18f20e258bb7 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:20.704641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-3e66c830-7f98-4451-8672-18f20e258bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:20.756312 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 32/66] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:32:20.803065 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3affde-30f5-4ef0-bbaf-0d4bbe90770b None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:20.803698 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3affde-30f5-4ef0-bbaf-0d4bbe90770b None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:20.804186 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3affde-30f5-4ef0-bbaf-0d4bbe90770b None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:20.805747 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 33/67] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:32:20.813554 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48b4fd-8218-438e-8c50-cfc7faf24eab None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:20.814090 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48b4fd-8218-438e-8c50-cfc7faf24eab None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:20.814644 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48b4fd-8218-438e-8c50-cfc7faf24eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:20.823561 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 35/68] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:32:20.833686 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66c830-7f98-4451-8672-18f20e258bb7 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:20.848667 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-0c48b4fd-8218-438e-8c50-cfc7faf24eab None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:20.850194 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-0c48b4fd-8218-438e-8c50-cfc7faf24eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:20.920711 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:20.975354 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66c830-7f98-4451-8672-18f20e258bb7 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:20.987866 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 34/69] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:21.042354 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc92ee-4930-4c19-a8a4-2e5beb459d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:21.043429 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc92ee-4930-4c19-a8a4-2e5beb459d5d None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:21.043933 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc92ee-4930-4c19-a8a4-2e5beb459d5d None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:21.044428 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc92ee-4930-4c19-a8a4-2e5beb459d5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:21.064071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc92ee-4930-4c19-a8a4-2e5beb459d5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:21.069139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-95bc92ee-4930-4c19-a8a4-2e5beb459d5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:21.069139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:21.069139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:21.069139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:21.069139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:21.069139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:21.069139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:21.069139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:21.069139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:21.069139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:21.069139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:21.069139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:21.069139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:21.069139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:21.069139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:21.069139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:21.069949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:21.069949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:21.069949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:21.069949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:21.069949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:21.069949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:21.069949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:21.069949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:21.069949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:21.069949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:21.069949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:21.069949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:21.069949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:21.069949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:21.069949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:21.069949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:21.070716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:21.070716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:21.070716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:21.070716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:21.070716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:21.070716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:21.070716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:21.070716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:21.070716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:21.070716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:21.070716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:21.070716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:21.072914 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 36/70] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:32:21.078873 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48b4fd-8218-438e-8c50-cfc7faf24eab None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:21.085427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc92ee-4930-4c19-a8a4-2e5beb459d5d None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:21.185073 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:21.223846 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc92ee-4930-4c19-a8a4-2e5beb459d5d None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:21.228219 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48b4fd-8218-438e-8c50-cfc7faf24eab None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:21.236271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:21.261820 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88becb-5cc0-4ada-9046-3c9b092f4c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:21.262457 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88becb-5cc0-4ada-9046-3c9b092f4c5a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:21.262738 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88becb-5cc0-4ada-9046-3c9b092f4c5a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:21.263012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88becb-5cc0-4ada-9046-3c9b092f4c5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:21.265090 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cb645-5eb9-4b6c-99ff-ee076a6d01b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:21.265723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cb645-5eb9-4b6c-99ff-ee076a6d01b4 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:21.265986 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cb645-5eb9-4b6c-99ff-ee076a6d01b4 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:21.266267 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cb645-5eb9-4b6c-99ff-ee076a6d01b4 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:21.266939 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cb645-5eb9-4b6c-99ff-ee076a6d01b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:21.267249 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cb645-5eb9-4b6c-99ff-ee076a6d01b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:21.268812 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cb645-5eb9-4b6c-99ff-ee076a6d01b4 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:21.273465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88becb-5cc0-4ada-9046-3c9b092f4c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:21.284393 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 35/71] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:21.284544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-fa88becb-5cc0-4ada-9046-3c9b092f4c5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:32:21.284544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:21.284544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:21.284544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:21.284544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:21.284544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:21.284544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:21.284544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:21.284544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:21.284544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:21.284544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:21.284544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:21.284544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:21.284544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:21.284544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:21.284544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:21.285378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:21.285378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:21.285378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:21.285378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:21.285378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:21.285378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:21.285378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:21.285378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:21.285378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:21.285378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:21.285378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:21.285378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:21.285378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:21.285378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:21.285378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:21.285378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:21.286112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:21.286112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:21.286112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:21.286112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:21.286112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:21.286112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:21.286112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:21.286112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:21.286112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:21.286112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:21.286112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:32:21.286112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:21.286686 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c8ddb-75d7-4c64-b278-eccde3a571d3 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:21.286686 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c8ddb-75d7-4c64-b278-eccde3a571d3 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:21.286686 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c8ddb-75d7-4c64-b278-eccde3a571d3 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:21.286855 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 37/72] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:32:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:32:21.286855 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88becb-5cc0-4ada-9046-3c9b092f4c5a None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:21.286975 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 36/73] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:21.286975 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c8ddb-75d7-4c64-b278-eccde3a571d3 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:21.387212 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c8ddb-75d7-4c64-b278-eccde3a571d3 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:21.396926 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88becb-5cc0-4ada-9046-3c9b092f4c5a None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:21.397218 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:21.421796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b72cf6-8c19-4765-9e0d-a6bedbe9012a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:21.422426 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b72cf6-8c19-4765-9e0d-a6bedbe9012a None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:21.422713 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b72cf6-8c19-4765-9e0d-a6bedbe9012a None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:21.422987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b72cf6-8c19-4765-9e0d-a6bedbe9012a None admin] PATH_INFO: `/v3/users/f016f79c903d413f83435d4998194d74` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:21.431737 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff6907-684c-4c98-9e38-db77722224ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:21.432394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff6907-684c-4c98-9e38-db77722224ac None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:21.432681 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff6907-684c-4c98-9e38-db77722224ac None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:21.432959 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff6907-684c-4c98-9e38-db77722224ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:21.436774 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b72cf6-8c19-4765-9e0d-a6bedbe9012a None admin] RBAC: Authorizing `identity:get_user(user_id=f016f79c903d413f83435d4998194d74)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:21.438166 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b72cf6-8c19-4765-9e0d-a6bedbe9012a None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:21.439772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 37/74] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:21 2022] GET /identity/v3/users/f016f79c903d413f83435d4998194d74 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:21.443703 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff6907-684c-4c98-9e38-db77722224ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:21.445458 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed193c-e107-4a5c-bf0e-2fbbb132f2b7 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:21.445746 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed193c-e107-4a5c-bf0e-2fbbb132f2b7 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:21.446024 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed193c-e107-4a5c-bf0e-2fbbb132f2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:21.448576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-79ff6907-684c-4c98-9e38-db77722224ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:21.448576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:21.448576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:21.448576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:21.448576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:21.448576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:21.448576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:21.448576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:21.448576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:21.448576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:21.448576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:21.448576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:21.448576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:21.448576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:21.448576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:21.448576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:21.449424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:21.449424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:21.449424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:21.449424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:21.449424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:21.449424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:21.449424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:21.449424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:21.449424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:21.449424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:21.449424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:21.449424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:21.449424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:21.449424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:21.449424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:21.449424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:21.450347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:21.450347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:21.450347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:21.450347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:21.450347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:21.450347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:21.450347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:21.450347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:21.450347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:21.450347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:21.450347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:21.450347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:21.450347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 38/75] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:32:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:21.451280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff6907-684c-4c98-9e38-db77722224ac None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:21.466817 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-3bed193c-e107-4a5c-bf0e-2fbbb132f2b7 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:21.467983 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-3bed193c-e107-4a5c-bf0e-2fbbb132f2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:21.482420 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:21.532944 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 38/76] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:21.533864 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed193c-e107-4a5c-bf0e-2fbbb132f2b7 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:21.563437 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff6907-684c-4c98-9e38-db77722224ac None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:21.597966 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2f73a-9ecb-470d-b1f7-e6e7479e41ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:21.598636 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2f73a-9ecb-470d-b1f7-e6e7479e41ef None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:21.598925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2f73a-9ecb-470d-b1f7-e6e7479e41ef None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:21.599207 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2f73a-9ecb-470d-b1f7-e6e7479e41ef None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:21.599921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2f73a-9ecb-470d-b1f7-e6e7479e41ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:21.600239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2f73a-9ecb-470d-b1f7-e6e7479e41ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:21.601664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2f73a-9ecb-470d-b1f7-e6e7479e41ef None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:21.610157 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 39/77] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:32:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:21.610794 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2f73a-9ecb-470d-b1f7-e6e7479e41ef None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:21.640196 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:21.644317 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed193c-e107-4a5c-bf0e-2fbbb132f2b7 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:21.681032 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42be231-a37c-42a3-a1c5-1859231ab0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:21.681675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42be231-a37c-42a3-a1c5-1859231ab0fa None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:21.681962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42be231-a37c-42a3-a1c5-1859231ab0fa None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:21.682245 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42be231-a37c-42a3-a1c5-1859231ab0fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:21.694642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42be231-a37c-42a3-a1c5-1859231ab0fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:21.700417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-f42be231-a37c-42a3-a1c5-1859231ab0fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:21.700417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:21.700417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:21.700417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:21.700417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:21.700417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:21.700417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:21.700417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:21.700417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:21.700417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:21.700417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:21.700417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:21.700417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:21.700417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:21.700417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:21.700417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:21.701469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:21.701469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:21.701469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:21.701469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:21.701469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:21.701469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:21.701469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:21.701469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:21.701469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:21.701469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:21.701469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:21.701469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:21.701469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:21.701469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:21.701469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:21.701469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:21.702440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:21.702440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:21.702440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:21.702440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:21.702440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:21.702440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:21.702440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:21.702440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:21.702440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:21.702440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:21.702440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:21.702440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:21.702440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 39/78] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:21.703178 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42be231-a37c-42a3-a1c5-1859231ab0fa None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:21.723518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:21.734739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2f73a-9ecb-470d-b1f7-e6e7479e41ef None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:21.772241 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d09e81-a541-4888-a4eb-e8525f1e66af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:21.772878 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d09e81-a541-4888-a4eb-e8525f1e66af None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:21.773167 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d09e81-a541-4888-a4eb-e8525f1e66af None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:21.773821 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d09e81-a541-4888-a4eb-e8525f1e66af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:21.808138 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42be231-a37c-42a3-a1c5-1859231ab0fa None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:21.841062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841c672-9f45-4d09-9d65-f403587f8425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:21.841673 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841c672-9f45-4d09-9d65-f403587f8425 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:21.841953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841c672-9f45-4d09-9d65-f403587f8425 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:21.842230 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841c672-9f45-4d09-9d65-f403587f8425 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:21.842886 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841c672-9f45-4d09-9d65-f403587f8425 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:21.843191 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841c672-9f45-4d09-9d65-f403587f8425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:21.844689 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841c672-9f45-4d09-9d65-f403587f8425 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:21.848455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d09e81-a541-4888-a4eb-e8525f1e66af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:21.850209 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d09e81-a541-4888-a4eb-e8525f1e66af None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:21.853278 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 40/79] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:21.854367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841c672-9f45-4d09-9d65-f403587f8425 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:21.879792 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:21.940038 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:21.950065 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 40/80] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:32:21.950900 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d09e81-a541-4888-a4eb-e8525f1e66af None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:21.960118 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841c672-9f45-4d09-9d65-f403587f8425 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:21.992974 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1957c6-9f66-43cc-8655-6de8ec94129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:21.993604 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1957c6-9f66-43cc-8655-6de8ec94129d None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:21.993890 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1957c6-9f66-43cc-8655-6de8ec94129d None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:21.994171 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1957c6-9f66-43cc-8655-6de8ec94129d None admin] PATH_INFO: `/v3/users/f016f79c903d413f83435d4998194d74` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:21.995314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1957c6-9f66-43cc-8655-6de8ec94129d None admin] RBAC: Authorizing `identity:get_user(user_id=f016f79c903d413f83435d4998194d74)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:21.996868 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1957c6-9f66-43cc-8655-6de8ec94129d None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:21.998437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 41/81] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:21 2022] GET /identity/v3/users/f016f79c903d413f83435d4998194d74 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:22.001612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1957c6-9f66-43cc-8655-6de8ec94129d None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:22.048640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d09e81-a541-4888-a4eb-e8525f1e66af None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:22.084576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59b034-1b0e-4f6e-b1bb-f8627b7ed843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:22.085179 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59b034-1b0e-4f6e-b1bb-f8627b7ed843 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:22.085463 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59b034-1b0e-4f6e-b1bb-f8627b7ed843 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:22.085738 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59b034-1b0e-4f6e-b1bb-f8627b7ed843 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:22.086418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59b034-1b0e-4f6e-b1bb-f8627b7ed843 None admin] RBAC: Adding query filter params (name=member) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:22.086726 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59b034-1b0e-4f6e-b1bb-f8627b7ed843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:22.088114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59b034-1b0e-4f6e-b1bb-f8627b7ed843 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:22.092852 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:22.097005 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 41/82] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:22.097852 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59b034-1b0e-4f6e-b1bb-f8627b7ed843 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:22.105730 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1957c6-9f66-43cc-8655-6de8ec94129d None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:22.139742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da856389-fa2f-43aa-9fbb-18f401237c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:22.140394 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da856389-fa2f-43aa-9fbb-18f401237c95 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:22.140678 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da856389-fa2f-43aa-9fbb-18f401237c95 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:22.140955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da856389-fa2f-43aa-9fbb-18f401237c95 None admin] PATH_INFO: `/v3/users/9f6d7830fd8e4f16950273e6f89f703c` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:22.142071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da856389-fa2f-43aa-9fbb-18f401237c95 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6d7830fd8e4f16950273e6f89f703c)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:22.143506 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da856389-fa2f-43aa-9fbb-18f401237c95 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:22.145095 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 42/83] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:21 2022] GET /identity/v3/users/9f6d7830fd8e4f16950273e6f89f703c => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:22.145937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da856389-fa2f-43aa-9fbb-18f401237c95 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:22.154481 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:22.204035 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59b034-1b0e-4f6e-b1bb-f8627b7ed843 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:22.237160 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c3159-e53b-492f-8886-a7c51e7bf224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:22.237799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c3159-e53b-492f-8886-a7c51e7bf224 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:22.238084 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c3159-e53b-492f-8886-a7c51e7bf224 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:22.238366 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c3159-e53b-492f-8886-a7c51e7bf224 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:22.239505 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c3159-e53b-492f-8886-a7c51e7bf224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:22.240991 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c3159-e53b-492f-8886-a7c51e7bf224 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:22.242545 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 42/84] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:22.244494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c3159-e53b-492f-8886-a7c51e7bf224 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:22.247485 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da856389-fa2f-43aa-9fbb-18f401237c95 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:22.280877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e558938-aa39-4f65-9e45-19522bbca963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:22.281498 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e558938-aa39-4f65-9e45-19522bbca963 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:22.281777 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e558938-aa39-4f65-9e45-19522bbca963 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:22.282050 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e558938-aa39-4f65-9e45-19522bbca963 None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:22.283169 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e558938-aa39-4f65-9e45-19522bbca963 None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:22.284629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e558938-aa39-4f65-9e45-19522bbca963 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:22.286229 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 43/85] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:22 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:22.291084 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e558938-aa39-4f65-9e45-19522bbca963 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:22.312007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:22.346857 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c3159-e53b-492f-8886-a7c51e7bf224 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:22.372233 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:22.385065 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e6c81-f7fa-4cc7-b210-31334bd0f3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:22.385680 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e6c81-f7fa-4cc7-b210-31334bd0f3c3 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:22.385972 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e6c81-f7fa-4cc7-b210-31334bd0f3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:22.386254 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e6c81-f7fa-4cc7-b210-31334bd0f3c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:22.392488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e558938-aa39-4f65-9e45-19522bbca963 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:22.425880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd117d-d9c9-4c12-a965-a89af41e570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:22.426541 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd117d-d9c9-4c12-a965-a89af41e570e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:22.426821 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd117d-d9c9-4c12-a965-a89af41e570e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:22.427098 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd117d-d9c9-4c12-a965-a89af41e570e None admin] PATH_INFO: `/v3/users/f016f79c903d413f83435d4998194d74` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:22.428212 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd117d-d9c9-4c12-a965-a89af41e570e None admin] RBAC: Authorizing `identity:get_user(user_id=f016f79c903d413f83435d4998194d74)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:22.429718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd117d-d9c9-4c12-a965-a89af41e570e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:22.431274 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 44/86] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:22 2022] GET /identity/v3/users/f016f79c903d413f83435d4998194d74 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:22.432029 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd117d-d9c9-4c12-a965-a89af41e570e None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:22.459253 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e6c81-f7fa-4cc7-b210-31334bd0f3c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:22.461343 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e6c81-f7fa-4cc7-b210-31334bd0f3c3 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:22.520915 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:22.530280 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd117d-d9c9-4c12-a965-a89af41e570e None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:22.558234 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 43/87] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:32:22.559576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e6c81-f7fa-4cc7-b210-31334bd0f3c3 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:22.564802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91134849-f430-42b6-b5ad-3566ae4f714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:22.565419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91134849-f430-42b6-b5ad-3566ae4f714b None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:22.565702 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91134849-f430-42b6-b5ad-3566ae4f714b None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:22.565978 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91134849-f430-42b6-b5ad-3566ae4f714b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:22.582858 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:22.633404 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91134849-f430-42b6-b5ad-3566ae4f714b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:22.634890 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91134849-f430-42b6-b5ad-3566ae4f714b None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:22.659167 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e6c81-f7fa-4cc7-b210-31334bd0f3c3 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:22.700401 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6690e03-1ff9-4ec6-9b9e-ca0bafdeea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:22.701019 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6690e03-1ff9-4ec6-9b9e-ca0bafdeea64 None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:22.701301 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6690e03-1ff9-4ec6-9b9e-ca0bafdeea64 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:22.701578 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6690e03-1ff9-4ec6-9b9e-ca0bafdeea64 None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:22.702230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6690e03-1ff9-4ec6-9b9e-ca0bafdeea64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:22.703889 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6690e03-1ff9-4ec6-9b9e-ca0bafdeea64 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:22.725340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:22.735498 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 45/88] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:32:22.737322 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91134849-f430-42b6-b5ad-3566ae4f714b None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:22.744704 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 44/89] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Sep 24 20:32:22 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:32:22.745787 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6690e03-1ff9-4ec6-9b9e-ca0bafdeea64 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:22.844176 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:22.855218 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91134849-f430-42b6-b5ad-3566ae4f714b None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:22.872245 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6690e03-1ff9-4ec6-9b9e-ca0bafdeea64 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:22.892532 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537e657-a805-455b-b0b5-b03d787fa091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:22.893156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537e657-a805-455b-b0b5-b03d787fa091 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:22.893440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537e657-a805-455b-b0b5-b03d787fa091 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:22.893716 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537e657-a805-455b-b0b5-b03d787fa091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:22.894452 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537e657-a805-455b-b0b5-b03d787fa091 None admin] RBAC: Adding query filter params (role.id=3481273c76dc4a20b3f73c4f8ea558e6, scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa, user.id=f016f79c903d413f83435d4998194d74) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:22.894762 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537e657-a805-455b-b0b5-b03d787fa091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:22.896220 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537e657-a805-455b-b0b5-b03d787fa091 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:22.902736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 46/90] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:22 2022] GET /identity/v3/role_assignments?user.id=f016f79c903d413f83435d4998194d74&scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa&role.id=3481273c76dc4a20b3f73c4f8ea558e6 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:22.911729 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0de2a-4909-4942-a225-49b140c5fde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:22.912406 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0de2a-4909-4942-a225-49b140c5fde0 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:22.912694 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0de2a-4909-4942-a225-49b140c5fde0 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:22.912969 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0de2a-4909-4942-a225-49b140c5fde0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:22.914205 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537e657-a805-455b-b0b5-b03d787fa091 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:22.995374 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:23.004058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0de2a-4909-4942-a225-49b140c5fde0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:23.007043 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0de2a-4909-4942-a225-49b140c5fde0 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:23.062680 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537e657-a805-455b-b0b5-b03d787fa091 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:23.110347 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec01726-78b0-4579-ac80-4d0068a76e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:23.111010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec01726-78b0-4579-ac80-4d0068a76e98 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:23.111326 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec01726-78b0-4579-ac80-4d0068a76e98 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:23.111594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec01726-78b0-4579-ac80-4d0068a76e98 None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:23.112171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:23.113910 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec01726-78b0-4579-ac80-4d0068a76e98 None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:23.115823 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec01726-78b0-4579-ac80-4d0068a76e98 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:23.117596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 47/91] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:22 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:23.118851 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec01726-78b0-4579-ac80-4d0068a76e98 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:23.141171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 45/92] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:32:23.142308 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0de2a-4909-4942-a225-49b140c5fde0 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:23.271258 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec01726-78b0-4579-ac80-4d0068a76e98 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:23.272728 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0de2a-4909-4942-a225-49b140c5fde0 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:23.303399 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:23.320772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d86ad0-8165-4391-8276-b66bf6cdb98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:23.321290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3d336-d1ee-45d0-b130-1b4e3cff4901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:23.321407 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d86ad0-8165-4391-8276-b66bf6cdb98e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:23.321687 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d86ad0-8165-4391-8276-b66bf6cdb98e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:23.321898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3d336-d1ee-45d0-b130-1b4e3cff4901 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:23.322019 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d86ad0-8165-4391-8276-b66bf6cdb98e None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:23.322188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3d336-d1ee-45d0-b130-1b4e3cff4901 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:23.322451 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3d336-d1ee-45d0-b130-1b4e3cff4901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:23.323206 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d86ad0-8165-4391-8276-b66bf6cdb98e None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:23.323307 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3d336-d1ee-45d0-b130-1b4e3cff4901 None admin] RBAC: Adding query filter params (role.id=905829118b764aa9920810cb3b86e0ce, scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa, user.id=f016f79c903d413f83435d4998194d74) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:23.323541 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3d336-d1ee-45d0-b130-1b4e3cff4901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:23.324799 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d86ad0-8165-4391-8276-b66bf6cdb98e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:23.325161 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf3d336-d1ee-45d0-b130-1b4e3cff4901 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:23.326808 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 48/93] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:23 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:23.327856 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d86ad0-8165-4391-8276-b66bf6cdb98e None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:23.333239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 46/94] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:23 2022] GET /identity/v3/role_assignments?user.id=f016f79c903d413f83435d4998194d74&scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa&role.id=905829118b764aa9920810cb3b86e0ce => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:23.334025 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3d336-d1ee-45d0-b130-1b4e3cff4901 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:23.435675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:23.562439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d86ad0-8165-4391-8276-b66bf6cdb98e None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:23.605891 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3d336-d1ee-45d0-b130-1b4e3cff4901 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:23.632045 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c06e4-7262-4fb7-af25-8307cca220a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:23.632737 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c06e4-7262-4fb7-af25-8307cca220a1 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:23.633021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c06e4-7262-4fb7-af25-8307cca220a1 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:23.633511 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c06e4-7262-4fb7-af25-8307cca220a1 None admin] PATH_INFO: `/v3/projects/a53edf5aef454c5b8f94639be0993091` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:23.634874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c06e4-7262-4fb7-af25-8307cca220a1 None admin] RBAC: Authorizing `identity:get_project(project_id=a53edf5aef454c5b8f94639be0993091)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:23.637239 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c06e4-7262-4fb7-af25-8307cca220a1 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:23.639274 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 49/95] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:23 2022] GET /identity/v3/projects/a53edf5aef454c5b8f94639be0993091 => generated 312 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:23.645416 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c06e4-7262-4fb7-af25-8307cca220a1 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:23.703577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc46d0-c187-4553-9488-8c76d804f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:23.704194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc46d0-c187-4553-9488-8c76d804f54e None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:23.711365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc46d0-c187-4553-9488-8c76d804f54e None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:23.711674 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc46d0-c187-4553-9488-8c76d804f54e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:23.712446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc46d0-c187-4553-9488-8c76d804f54e None admin] RBAC: Adding query filter params (role.id=9cc90aa0ccde4b75b7642101cbf45cf2, scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa, user.id=9f6d7830fd8e4f16950273e6f89f703c) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:23.712764 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc46d0-c187-4553-9488-8c76d804f54e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:23.714426 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc46d0-c187-4553-9488-8c76d804f54e None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:23.724796 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 47/96] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:23 2022] GET /identity/v3/role_assignments?user.id=9f6d7830fd8e4f16950273e6f89f703c&scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa&role.id=9cc90aa0ccde4b75b7642101cbf45cf2 => generated 259 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:23.745047 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:23.802551 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c06e4-7262-4fb7-af25-8307cca220a1 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:23.861244 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd4b02-cf88-406a-92c2-50a2097ff3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:23.861786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd4b02-cf88-406a-92c2-50a2097ff3cb None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:23.862065 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd4b02-cf88-406a-92c2-50a2097ff3cb None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:23.862338 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd4b02-cf88-406a-92c2-50a2097ff3cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:23.863068 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd4b02-cf88-406a-92c2-50a2097ff3cb None admin] RBAC: Adding query filter params (role.id=3481273c76dc4a20b3f73c4f8ea558e6, scope.project.id=a53edf5aef454c5b8f94639be0993091, user.id=f016f79c903d413f83435d4998194d74) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:23.863382 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd4b02-cf88-406a-92c2-50a2097ff3cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:23.864889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd4b02-cf88-406a-92c2-50a2097ff3cb None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:23.877261 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 50/97] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:23 2022] GET /identity/v3/role_assignments?user.id=f016f79c903d413f83435d4998194d74&scope.project.id=a53edf5aef454c5b8f94639be0993091&role.id=3481273c76dc4a20b3f73c4f8ea558e6 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:25.920895 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e8a27-2cdc-44d5-aab1-b9e74297e50f None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:25.921910 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e8a27-2cdc-44d5-aab1-b9e74297e50f None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:25.922424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e8a27-2cdc-44d5-aab1-b9e74297e50f None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:25.923955 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 48/98] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:25.929769 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e091a-3ae1-40e9-84c5-d55a47cce626 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:25.930612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e091a-3ae1-40e9-84c5-d55a47cce626 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:25.931084 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e091a-3ae1-40e9-84c5-d55a47cce626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:25.954564 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-086e091a-3ae1-40e9-84c5-d55a47cce626 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:25.956092 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-086e091a-3ae1-40e9-84c5-d55a47cce626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:26.035619 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f496a7-b7f6-425f-ba68-c3b3ed70bddf None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:26.036329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f496a7-b7f6-425f-ba68-c3b3ed70bddf None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:26.036848 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f496a7-b7f6-425f-ba68-c3b3ed70bddf None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:26.038098 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 51/99] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:26.038794 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 49/100] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:26.064845 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d545c-21f2-4716-813a-852c636cb9e0 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:26.065134 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d545c-21f2-4716-813a-852c636cb9e0 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:26.065409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d545c-21f2-4716-813a-852c636cb9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:26.087914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-515d545c-21f2-4716-813a-852c636cb9e0 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:26.089223 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-515d545c-21f2-4716-813a-852c636cb9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:26.173501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:26.178045 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0ce9b-52a3-4201-9c2b-7c2b025e7824 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:26.178637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0ce9b-52a3-4201-9c2b-7c2b025e7824 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:26.179034 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 52/101] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:26.179703 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0ce9b-52a3-4201-9c2b-7c2b025e7824 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:26.181276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 50/102] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:32:26.187109 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb98dc-d2be-4e3e-82bc-d23be3954947 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:26.187397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb98dc-d2be-4e3e-82bc-d23be3954947 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:26.187674 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb98dc-d2be-4e3e-82bc-d23be3954947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:26.217474 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-41fb98dc-d2be-4e3e-82bc-d23be3954947 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:26.218743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-41fb98dc-d2be-4e3e-82bc-d23be3954947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:26.304612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 53/103] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:26.519741 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0ce9b-52a3-4201-9c2b-7c2b025e7824 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:26.621921 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb98dc-d2be-4e3e-82bc-d23be3954947 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:26.646671 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0ce9b-52a3-4201-9c2b-7c2b025e7824 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:26.656641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:26.704006 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81638d-fcb5-4e99-8eb4-7367cd182513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:26.705030 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81638d-fcb5-4e99-8eb4-7367cd182513 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:26.705560 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81638d-fcb5-4e99-8eb4-7367cd182513 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:26.706066 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81638d-fcb5-4e99-8eb4-7367cd182513 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:26.718268 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81638d-fcb5-4e99-8eb4-7367cd182513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:26.726408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-6b81638d-fcb5-4e99-8eb4-7367cd182513 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:32:26.726408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:26.726408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:26.726408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:26.726408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:26.726408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:26.726408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:26.726408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:26.726408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:26.726408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:26.726408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:26.726408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:26.726408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:26.726408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:26.726408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:26.726408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:26.727279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:26.727279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:26.727279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:26.727279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:26.727279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:26.727279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:26.727279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:26.727279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:26.727279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:26.727279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:26.727279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:26.727279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:26.727279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:26.727279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:26.727279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:26.727279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:26.728075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:26.728075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:26.728075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:26.728075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:26.728075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:26.728075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:26.728075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:26.728075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:26.728075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:26.728075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:26.728075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:32:26.728075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:26.731083 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 51/104] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:26.741686 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81638d-fcb5-4e99-8eb4-7367cd182513 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:26.786953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb98dc-d2be-4e3e-82bc-d23be3954947 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:26.823504 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:26.862154 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b5443-82a3-4ccc-8461-3ad17e8ec1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:26.862805 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b5443-82a3-4ccc-8461-3ad17e8ec1cc None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:26.863085 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b5443-82a3-4ccc-8461-3ad17e8ec1cc None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:26.865748 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b5443-82a3-4ccc-8461-3ad17e8ec1cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:26.888053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b5443-82a3-4ccc-8461-3ad17e8ec1cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:26.899238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-af7b5443-82a3-4ccc-8461-3ad17e8ec1cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:26.899238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:26.899238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:26.899238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:26.899238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:26.899238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:26.899238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:26.899238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:26.899238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:26.899238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:26.899238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:26.899238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:26.899238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:26.899238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:26.899238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:26.899238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:26.900100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:26.900100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:26.900100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:26.900100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:26.900100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:26.900100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:26.900100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:26.900100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:26.900100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:26.900100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:26.900100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:26.900100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:26.900100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:26.900100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:26.900100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:26.900100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:26.900916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:26.900916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:26.900916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:26.900916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:26.900916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:26.900916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:26.900916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:26.900916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:26.900916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:26.900916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:26.900916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:26.900916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:26.900916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 54/105] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:26.906948 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b5443-82a3-4ccc-8461-3ad17e8ec1cc None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:26.952131 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81638d-fcb5-4e99-8eb4-7367cd182513 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:26.990809 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1d79a-6bad-4d57-8c38-5ebacb3824b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:26.991433 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1d79a-6bad-4d57-8c38-5ebacb3824b8 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:26.992082 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1d79a-6bad-4d57-8c38-5ebacb3824b8 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:26.992082 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1d79a-6bad-4d57-8c38-5ebacb3824b8 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:26.992656 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1d79a-6bad-4d57-8c38-5ebacb3824b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:26.992965 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1d79a-6bad-4d57-8c38-5ebacb3824b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:26.994353 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1d79a-6bad-4d57-8c38-5ebacb3824b8 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:27.003894 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 52/106] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:27.004741 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1d79a-6bad-4d57-8c38-5ebacb3824b8 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:27.034214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:27.117219 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1d79a-6bad-4d57-8c38-5ebacb3824b8 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:27.141567 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b5443-82a3-4ccc-8461-3ad17e8ec1cc None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:27.158180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6844a5-a1f6-4b2d-a845-8c19b9466495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:27.158825 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6844a5-a1f6-4b2d-a845-8c19b9466495 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:27.159110 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6844a5-a1f6-4b2d-a845-8c19b9466495 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:27.159386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6844a5-a1f6-4b2d-a845-8c19b9466495 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:27.160532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6844a5-a1f6-4b2d-a845-8c19b9466495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:27.161988 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6844a5-a1f6-4b2d-a845-8c19b9466495 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:27.163618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 53/107] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:27.164392 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6844a5-a1f6-4b2d-a845-8c19b9466495 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:27.248523 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567858ae-dbb1-45a5-821b-d7df79418a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:27.249150 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567858ae-dbb1-45a5-821b-d7df79418a5e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:27.249433 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567858ae-dbb1-45a5-821b-d7df79418a5e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:27.249707 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567858ae-dbb1-45a5-821b-d7df79418a5e None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:27.250486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567858ae-dbb1-45a5-821b-d7df79418a5e None admin] RBAC: Adding query filter params (name=member) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:27.250798 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567858ae-dbb1-45a5-821b-d7df79418a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:27.252291 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567858ae-dbb1-45a5-821b-d7df79418a5e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:27.268947 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 55/108] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:27.269785 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567858ae-dbb1-45a5-821b-d7df79418a5e None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:27.280685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:27.286221 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6844a5-a1f6-4b2d-a845-8c19b9466495 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:27.345247 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:27.352950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948e52-24b1-42dc-996c-d7f76f612372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:27.353595 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948e52-24b1-42dc-996c-d7f76f612372 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:27.353877 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948e52-24b1-42dc-996c-d7f76f612372 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:27.354154 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948e52-24b1-42dc-996c-d7f76f612372 None admin] PATH_INFO: `/v3/users/664bd13e952b45c0bc6d0a00900ede34` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:27.384683 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee948e52-24b1-42dc-996c-d7f76f612372 None admin] RBAC: Authorizing `identity:get_user(user_id=664bd13e952b45c0bc6d0a00900ede34)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:27.386074 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee948e52-24b1-42dc-996c-d7f76f612372 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:27.390295 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 54/109] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:27 2022] GET /identity/v3/users/664bd13e952b45c0bc6d0a00900ede34 => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:27.391100 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948e52-24b1-42dc-996c-d7f76f612372 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:27.477137 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567858ae-dbb1-45a5-821b-d7df79418a5e None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:27.516220 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5c55b-e713-4676-b473-f2ea20b5f681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:27.517154 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5c55b-e713-4676-b473-f2ea20b5f681 None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:27.517438 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5c55b-e713-4676-b473-f2ea20b5f681 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:27.518211 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5c55b-e713-4676-b473-f2ea20b5f681 None admin] PATH_INFO: `/v3/projects` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:27.519130 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5c55b-e713-4676-b473-f2ea20b5f681 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:27.520883 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5c55b-e713-4676-b473-f2ea20b5f681 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:27.538070 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948e52-24b1-42dc-996c-d7f76f612372 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:27.565260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 56/110] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Sep 24 20:32:27 2022] POST /identity/v3/projects => generated 302 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:32:27.566438 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5c55b-e713-4676-b473-f2ea20b5f681 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:27.580583 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a369a2-fb75-43f8-b6ba-3ca6ba5eeff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:27.581391 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a369a2-fb75-43f8-b6ba-3ca6ba5eeff2 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:27.581773 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a369a2-fb75-43f8-b6ba-3ca6ba5eeff2 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:27.582125 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a369a2-fb75-43f8-b6ba-3ca6ba5eeff2 None admin] PATH_INFO: `/v3/users/f016f79c903d413f83435d4998194d74` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:27.583579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a369a2-fb75-43f8-b6ba-3ca6ba5eeff2 None admin] RBAC: Authorizing `identity:get_user(user_id=f016f79c903d413f83435d4998194d74)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:27.585186 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a369a2-fb75-43f8-b6ba-3ca6ba5eeff2 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:27.587541 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 55/111] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:27 2022] GET /identity/v3/users/f016f79c903d413f83435d4998194d74 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:27.592881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf04d4-c7bc-4011-9c33-799776c1365c None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:27.593333 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf04d4-c7bc-4011-9c33-799776c1365c None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:27.593697 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf04d4-c7bc-4011-9c33-799776c1365c None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:27.595498 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 56/112] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:27.602978 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf04d4-c7bc-4011-9c33-799776c1365c None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:27.631578 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:27.687552 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:27.703087 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5c55b-e713-4676-b473-f2ea20b5f681 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:27.723100 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf04d4-c7bc-4011-9c33-799776c1365c None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:27.740212 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047a7fb-ffaf-44a7-85fe-7ec6b35ec3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:27.740906 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047a7fb-ffaf-44a7-85fe-7ec6b35ec3bd None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:27.741200 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047a7fb-ffaf-44a7-85fe-7ec6b35ec3bd None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:27.741488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047a7fb-ffaf-44a7-85fe-7ec6b35ec3bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:27.766889 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe66c6-16d0-47e5-aba6-431ee849f36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:27.767542 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe66c6-16d0-47e5-aba6-431ee849f36a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:27.767831 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe66c6-16d0-47e5-aba6-431ee849f36a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:27.768172 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe66c6-16d0-47e5-aba6-431ee849f36a None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:27.769776 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe66c6-16d0-47e5-aba6-431ee849f36a None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:27.771335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe66c6-16d0-47e5-aba6-431ee849f36a None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:27.773430 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 57/113] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:27 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:27.774594 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552d8ff-b16d-4ac5-a353-b62efba08f06 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:27.774881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552d8ff-b16d-4ac5-a353-b62efba08f06 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:27.775247 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552d8ff-b16d-4ac5-a353-b62efba08f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:27.801283 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-b552d8ff-b16d-4ac5-a353-b62efba08f06 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:27.802565 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-b552d8ff-b16d-4ac5-a353-b62efba08f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:27.818337 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047a7fb-ffaf-44a7-85fe-7ec6b35ec3bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:27.819852 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047a7fb-ffaf-44a7-85fe-7ec6b35ec3bd None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:27.877801 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 58/114] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:27.879073 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c90e97-a453-427a-a045-93ac2bb74e74 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:27.879360 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c90e97-a453-427a-a045-93ac2bb74e74 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:27.880670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c90e97-a453-427a-a045-93ac2bb74e74 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:27.882404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 59/115] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:27.883540 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c90e97-a453-427a-a045-93ac2bb74e74 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:27.917263 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:27.921660 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:27.939380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 57/116] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:32:27.944082 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86379670-cb2f-4a1b-9475-1bec76b6fbd2 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:27.944082 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86379670-cb2f-4a1b-9475-1bec76b6fbd2 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:27.944082 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86379670-cb2f-4a1b-9475-1bec76b6fbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:27.965334 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-86379670-cb2f-4a1b-9475-1bec76b6fbd2 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:27.966527 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-86379670-cb2f-4a1b-9475-1bec76b6fbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:28.023022 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c90e97-a453-427a-a045-93ac2bb74e74 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:28.038248 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 58/117] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:28.039993 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced8389-5340-4c52-96be-802e1993cdf0 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:28.040369 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced8389-5340-4c52-96be-802e1993cdf0 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:28.040768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced8389-5340-4c52-96be-802e1993cdf0 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:28.042316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 59/118] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:28.043772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced8389-5340-4c52-96be-802e1993cdf0 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:28.069658 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f39483-cd98-46de-9062-2b6580f0ee4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:28.070334 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f39483-cd98-46de-9062-2b6580f0ee4d None admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:28.070742 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f39483-cd98-46de-9062-2b6580f0ee4d None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:28.071029 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f39483-cd98-46de-9062-2b6580f0ee4d None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa/users/f016f79c903d413f83435d4998194d74/roles/3481273c76dc4a20b3f73c4f8ea558e6` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:28.073114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f39483-cd98-46de-9062-2b6580f0ee4d None admin] RBAC: Authorizing `identity:create_grant(project_id=0acc8c7eebf94a958818fae44bb2a0aa, user_id=f016f79c903d413f83435d4998194d74, role_id=3481273c76dc4a20b3f73c4f8ea558e6)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:28.076829 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f39483-cd98-46de-9062-2b6580f0ee4d None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:28.107555 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 60/119] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Sep 24 20:32:27 2022] PUT /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa/users/f016f79c903d413f83435d4998194d74/roles/3481273c76dc4a20b3f73c4f8ea558e6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:32:28.109186 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd64f9e-971d-4b3c-8edb-329bc2ee99b4 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:28.109695 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd64f9e-971d-4b3c-8edb-329bc2ee99b4 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:28.110181 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd64f9e-971d-4b3c-8edb-329bc2ee99b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:28.151587 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-dcd64f9e-971d-4b3c-8edb-329bc2ee99b4 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:28.156235 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-dcd64f9e-971d-4b3c-8edb-329bc2ee99b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:28.216393 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced8389-5340-4c52-96be-802e1993cdf0 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:28.254967 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:28.275862 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 61/120] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:28.284077 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1268b5-8b6e-44dd-a792-a57a16cabd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:28.284768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1268b5-8b6e-44dd-a792-a57a16cabd2f None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:28.285094 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1268b5-8b6e-44dd-a792-a57a16cabd2f None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:28.285371 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1268b5-8b6e-44dd-a792-a57a16cabd2f None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:28.286550 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1268b5-8b6e-44dd-a792-a57a16cabd2f None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:28.288066 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1268b5-8b6e-44dd-a792-a57a16cabd2f None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:28.289805 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 60/121] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:28 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:28.296767 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd64f9e-971d-4b3c-8edb-329bc2ee99b4 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:28.316769 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:28.339183 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1268b5-8b6e-44dd-a792-a57a16cabd2f None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:28.485494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd64f9e-971d-4b3c-8edb-329bc2ee99b4 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:28.526808 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1268b5-8b6e-44dd-a792-a57a16cabd2f None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:28.551151 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0163dc2-bc6a-48ef-908e-13569bb8e703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:28.551767 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0163dc2-bc6a-48ef-908e-13569bb8e703 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:28.552041 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0163dc2-bc6a-48ef-908e-13569bb8e703 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:28.552312 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0163dc2-bc6a-48ef-908e-13569bb8e703 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:28.553067 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0163dc2-bc6a-48ef-908e-13569bb8e703 None admin] RBAC: Adding query filter params (role.id=11b3648aadfb4d19b376c5acc9465a44, scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa, user.id=664bd13e952b45c0bc6d0a00900ede34) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:28.553376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0163dc2-bc6a-48ef-908e-13569bb8e703 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:28.554812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0163dc2-bc6a-48ef-908e-13569bb8e703 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:28.568066 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 62/122] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:28 2022] GET /identity/v3/role_assignments?user.id=664bd13e952b45c0bc6d0a00900ede34&scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa&role.id=11b3648aadfb4d19b376c5acc9465a44 => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:28.568834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0163dc2-bc6a-48ef-908e-13569bb8e703 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:28.599310 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0322f-d5b3-4388-a419-af9caf59c61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:28.599963 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0322f-d5b3-4388-a419-af9caf59c61f None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:28.600239 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0322f-d5b3-4388-a419-af9caf59c61f None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:28.600536 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0322f-d5b3-4388-a419-af9caf59c61f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:28.620318 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0322f-d5b3-4388-a419-af9caf59c61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:28.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-67b0322f-d5b3-4388-a419-af9caf59c61f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:32:28.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:28.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:28.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:28.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:28.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:28.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:28.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:28.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:28.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:28.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:28.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:28.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:28.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:28.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:28.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:28.627463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:28.627463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:28.627463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:28.627463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:28.627463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:28.627463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:28.627463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:28.627463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:28.627463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:28.627463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:28.627463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:28.627463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:28.627463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:28.627463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:28.627463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:28.627463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:28.628270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:28.628270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:28.628270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:28.628270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:28.628270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:28.628270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:28.628270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:28.628270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:28.628270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:28.628270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:28.628270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:32:28.628270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:28.629422 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 61/123] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:32:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:28.636079 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0322f-d5b3-4388-a419-af9caf59c61f None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:28.713199 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:28.728454 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:28.748200 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0163dc2-bc6a-48ef-908e-13569bb8e703 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:28.805134 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5d63b-cf76-44e5-8240-f69615481cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:28.805892 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5d63b-cf76-44e5-8240-f69615481cec None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:28.806185 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5d63b-cf76-44e5-8240-f69615481cec None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:28.806465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5d63b-cf76-44e5-8240-f69615481cec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:28.812816 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0322f-d5b3-4388-a419-af9caf59c61f None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:28.818036 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5d63b-cf76-44e5-8240-f69615481cec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:28.824246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-c7d5d63b-cf76-44e5-8240-f69615481cec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:28.824246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:28.824246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:28.824246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:28.824246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:28.824246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:28.824246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:28.824246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:28.824246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:28.824246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:28.824246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:28.824246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:28.824246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:28.824246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:28.824246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:28.824246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:28.825180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:28.825180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:28.825180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:28.825180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:28.825180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:28.825180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:28.825180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:28.825180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:28.825180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:28.825180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:28.825180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:28.825180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:28.825180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:28.825180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:28.825180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:28.825180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:28.825940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:28.825940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:28.825940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:28.825940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:28.825940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:28.825940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:28.825940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:28.825940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:28.825940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:28.825940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:28.825940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:28.825940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:28.825940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 63/124] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:32:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:28.826576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5d63b-cf76-44e5-8240-f69615481cec None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:28.855787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031643e1-49c3-46f2-aca8-5ff44902b5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:28.856457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031643e1-49c3-46f2-aca8-5ff44902b5e2 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:28.856740 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031643e1-49c3-46f2-aca8-5ff44902b5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:28.857012 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031643e1-49c3-46f2-aca8-5ff44902b5e2 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:28.857698 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031643e1-49c3-46f2-aca8-5ff44902b5e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:28.858001 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031643e1-49c3-46f2-aca8-5ff44902b5e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:28.859430 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031643e1-49c3-46f2-aca8-5ff44902b5e2 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:28.869298 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 62/125] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:32:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:28.870243 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031643e1-49c3-46f2-aca8-5ff44902b5e2 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:28.995135 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031643e1-49c3-46f2-aca8-5ff44902b5e2 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:29.005142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:29.018073 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5d63b-cf76-44e5-8240-f69615481cec None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:29.045807 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fc9ef-27b4-4588-a472-06be5bf5485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:29.048399 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fc9ef-27b4-4588-a472-06be5bf5485e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:29.048693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fc9ef-27b4-4588-a472-06be5bf5485e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:29.048974 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fc9ef-27b4-4588-a472-06be5bf5485e None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:29.051453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fc9ef-27b4-4588-a472-06be5bf5485e None admin] RBAC: Adding query filter params (name=admin) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:29.051773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fc9ef-27b4-4588-a472-06be5bf5485e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:29.053194 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fc9ef-27b4-4588-a472-06be5bf5485e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:29.072668 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 63/126] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:29.073550 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fc9ef-27b4-4588-a472-06be5bf5485e None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:29.091557 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fb90d-5321-4d92-9b6e-9f0bd203adeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:29.092258 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fb90d-5321-4d92-9b6e-9f0bd203adeb None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:29.092595 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fb90d-5321-4d92-9b6e-9f0bd203adeb None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:29.092872 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fb90d-5321-4d92-9b6e-9f0bd203adeb None admin] PATH_INFO: `/v3/roles/member` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:29.095557 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:29.106727 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fb90d-5321-4d92-9b6e-9f0bd203adeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:29.111739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-c67fb90d-5321-4d92-9b6e-9f0bd203adeb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:29.111739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:29.111739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:29.111739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:29.111739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:29.111739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:29.111739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:29.111739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:29.111739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:29.111739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:29.111739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:29.111739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:29.111739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:29.111739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:29.111739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:29.111739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:29.112631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:29.112631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:29.112631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:29.112631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:29.112631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:29.112631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:29.112631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:29.112631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:29.112631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:29.112631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:29.112631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:29.112631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:29.112631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:29.112631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:29.112631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:29.112631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:29.113389 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:29.113389 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:29.113389 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:29.113389 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:29.113389 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:29.113389 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:29.113389 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:29.113389 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:29.113389 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:29.113389 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:29.113389 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:29.113389 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:29.113389 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 64/127] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:29.114535 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fb90d-5321-4d92-9b6e-9f0bd203adeb None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:29.223110 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fb90d-5321-4d92-9b6e-9f0bd203adeb None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:29.259702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4778e0-a97e-46a3-8fab-2a5f95139caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:29.260287 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4778e0-a97e-46a3-8fab-2a5f95139caf None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:29.260608 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4778e0-a97e-46a3-8fab-2a5f95139caf None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:29.260888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4778e0-a97e-46a3-8fab-2a5f95139caf None admin] PATH_INFO: `/v3/users/9f6d7830fd8e4f16950273e6f89f703c` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:29.262677 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4778e0-a97e-46a3-8fab-2a5f95139caf None admin] RBAC: Authorizing `identity:get_user(user_id=9f6d7830fd8e4f16950273e6f89f703c)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:29.264178 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4778e0-a97e-46a3-8fab-2a5f95139caf None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:29.265829 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 65/128] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:29 2022] GET /identity/v3/users/9f6d7830fd8e4f16950273e6f89f703c => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:29.266619 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4778e0-a97e-46a3-8fab-2a5f95139caf None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:29.273269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fc9ef-27b4-4588-a472-06be5bf5485e None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:29.310849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51924c72-942d-4445-88fe-0794780a761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:29.311847 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51924c72-942d-4445-88fe-0794780a761e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:29.312453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51924c72-942d-4445-88fe-0794780a761e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:29.312959 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51924c72-942d-4445-88fe-0794780a761e None admin] PATH_INFO: `/v3/users/f016f79c903d413f83435d4998194d74` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:29.314340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51924c72-942d-4445-88fe-0794780a761e None admin] RBAC: Authorizing `identity:get_user(user_id=f016f79c903d413f83435d4998194d74)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:29.316210 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51924c72-942d-4445-88fe-0794780a761e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:29.318129 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 64/129] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:29 2022] GET /identity/v3/users/f016f79c903d413f83435d4998194d74 => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:29.319156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51924c72-942d-4445-88fe-0794780a761e None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:29.336910 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:29.380898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4778e0-a97e-46a3-8fab-2a5f95139caf None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:29.388952 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:29.445657 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d16343-3e27-4935-b35c-ac37faba9792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:29.446334 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d16343-3e27-4935-b35c-ac37faba9792 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:29.446626 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d16343-3e27-4935-b35c-ac37faba9792 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:29.446907 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d16343-3e27-4935-b35c-ac37faba9792 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:29.447578 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d16343-3e27-4935-b35c-ac37faba9792 None admin] RBAC: Adding query filter params (name=member) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:29.447886 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d16343-3e27-4935-b35c-ac37faba9792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:29.449818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d16343-3e27-4935-b35c-ac37faba9792 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:29.468587 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 66/130] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:29.469445 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d16343-3e27-4935-b35c-ac37faba9792 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:29.489158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51924c72-942d-4445-88fe-0794780a761e None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:29.527238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4839b6-02a4-41a5-921b-a962f6def93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:29.527791 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4839b6-02a4-41a5-921b-a962f6def93e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:29.528073 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4839b6-02a4-41a5-921b-a962f6def93e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:29.528365 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4839b6-02a4-41a5-921b-a962f6def93e None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:29.534136 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4839b6-02a4-41a5-921b-a962f6def93e None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:29.535600 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4839b6-02a4-41a5-921b-a962f6def93e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:29.537237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 65/131] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:29 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:29.538005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4839b6-02a4-41a5-921b-a962f6def93e None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:29.678841 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d16343-3e27-4935-b35c-ac37faba9792 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:29.708980 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4839b6-02a4-41a5-921b-a962f6def93e None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:29.726866 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:29.728667 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:29.754652 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5c947-7b46-44ea-8e6b-a101df118fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:29.755305 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5c947-7b46-44ea-8e6b-a101df118fed None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:29.755591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5c947-7b46-44ea-8e6b-a101df118fed None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:29.755872 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5c947-7b46-44ea-8e6b-a101df118fed None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:29.761182 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5c947-7b46-44ea-8e6b-a101df118fed None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:29.763567 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5c947-7b46-44ea-8e6b-a101df118fed None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:29.764966 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fc88a-93ab-4e4e-ab1d-5c27407a3368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:29.765413 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 67/132] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:29 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:29.765916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fc88a-93ab-4e4e-ab1d-5c27407a3368 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:29.766162 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5c947-7b46-44ea-8e6b-a101df118fed None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:29.766261 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fc88a-93ab-4e4e-ab1d-5c27407a3368 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:29.766462 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818fc88a-93ab-4e4e-ab1d-5c27407a3368 None admin] PATH_INFO: `/v3/users/f016f79c903d413f83435d4998194d74` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:29.774025 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fc88a-93ab-4e4e-ab1d-5c27407a3368 None admin] RBAC: Authorizing `identity:get_user(user_id=f016f79c903d413f83435d4998194d74)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:29.779493 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818fc88a-93ab-4e4e-ab1d-5c27407a3368 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:29.782094 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 66/133] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:29 2022] GET /identity/v3/users/f016f79c903d413f83435d4998194d74 => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:29.782964 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fc88a-93ab-4e4e-ab1d-5c27407a3368 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:29.911449 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5c947-7b46-44ea-8e6b-a101df118fed None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:29.947568 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818fc88a-93ab-4e4e-ab1d-5c27407a3368 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:29.948258 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad48443-e61c-45a1-9774-3e9a01210020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:29.949048 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad48443-e61c-45a1-9774-3e9a01210020 None admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:29.949333 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad48443-e61c-45a1-9774-3e9a01210020 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:29.949611 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad48443-e61c-45a1-9774-3e9a01210020 None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa/users/9f6d7830fd8e4f16950273e6f89f703c/roles/9cc90aa0ccde4b75b7642101cbf45cf2` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:29.954453 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad48443-e61c-45a1-9774-3e9a01210020 None admin] RBAC: Authorizing `identity:create_grant(project_id=0acc8c7eebf94a958818fae44bb2a0aa, user_id=9f6d7830fd8e4f16950273e6f89f703c, role_id=9cc90aa0ccde4b75b7642101cbf45cf2)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:29.955897 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad48443-e61c-45a1-9774-3e9a01210020 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:29.981275 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 68/134] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Sep 24 20:32:29 2022] PUT /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa/users/9f6d7830fd8e4f16950273e6f89f703c/roles/9cc90aa0ccde4b75b7642101cbf45cf2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:32:29.982104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad48443-e61c-45a1-9774-3e9a01210020 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:30.024601 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dac4a-fab8-4980-b85a-77019f40004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:30.025291 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dac4a-fab8-4980-b85a-77019f40004d None admin] REQUEST_METHOD: `PUT` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:30.025572 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dac4a-fab8-4980-b85a-77019f40004d None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:30.025854 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dac4a-fab8-4980-b85a-77019f40004d None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa/users/f016f79c903d413f83435d4998194d74/roles/905829118b764aa9920810cb3b86e0ce` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:30.031598 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111dac4a-fab8-4980-b85a-77019f40004d None admin] RBAC: Authorizing `identity:create_grant(project_id=0acc8c7eebf94a958818fae44bb2a0aa, user_id=f016f79c903d413f83435d4998194d74, role_id=905829118b764aa9920810cb3b86e0ce)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:30.033039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111dac4a-fab8-4980-b85a-77019f40004d None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:30.069360 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:30.070869 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 67/135] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Sep 24 20:32:29 2022] PUT /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa/users/f016f79c903d413f83435d4998194d74/roles/905829118b764aa9920810cb3b86e0ce => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:32:30.153730 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad48443-e61c-45a1-9774-3e9a01210020 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:30.211886 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03a59e-8092-402b-b917-9990ae94f1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:30.212978 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03a59e-8092-402b-b917-9990ae94f1be None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:30.213636 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03a59e-8092-402b-b917-9990ae94f1be None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:30.214152 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03a59e-8092-402b-b917-9990ae94f1be None admin] PATH_INFO: `/v3/projects/a53edf5aef454c5b8f94639be0993091` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:30.220197 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03a59e-8092-402b-b917-9990ae94f1be None admin] RBAC: Authorizing `identity:get_project(project_id=a53edf5aef454c5b8f94639be0993091)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:30.222175 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03a59e-8092-402b-b917-9990ae94f1be None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:30.224786 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 69/136] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:29 2022] GET /identity/v3/projects/a53edf5aef454c5b8f94639be0993091 => generated 312 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:30.230353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dac4a-fab8-4980-b85a-77019f40004d None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:30.290118 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:30.379482 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dac4a-fab8-4980-b85a-77019f40004d None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:30.423037 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d65c34-af28-492f-ae50-8a5afbdd4a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:30.424070 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65c34-af28-492f-ae50-8a5afbdd4a4c None admin] REQUEST_METHOD: `PUT` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:30.424604 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65c34-af28-492f-ae50-8a5afbdd4a4c None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:30.425123 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d65c34-af28-492f-ae50-8a5afbdd4a4c None admin] PATH_INFO: `/v3/projects/a53edf5aef454c5b8f94639be0993091/users/f016f79c903d413f83435d4998194d74/roles/3481273c76dc4a20b3f73c4f8ea558e6` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:30.427358 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d65c34-af28-492f-ae50-8a5afbdd4a4c None admin] RBAC: Authorizing `identity:create_grant(project_id=a53edf5aef454c5b8f94639be0993091, user_id=f016f79c903d413f83435d4998194d74, role_id=3481273c76dc4a20b3f73c4f8ea558e6)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:30.429235 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d65c34-af28-492f-ae50-8a5afbdd4a4c None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:30.446882 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 68/137] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Sep 24 20:32:30 2022] PUT /identity/v3/projects/a53edf5aef454c5b8f94639be0993091/users/f016f79c903d413f83435d4998194d74/roles/3481273c76dc4a20b3f73c4f8ea558e6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:32:30.845497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6feaf0-7997-4082-9316-3a8dae7719f7 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:30.846178 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6feaf0-7997-4082-9316-3a8dae7719f7 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:30.846663 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6feaf0-7997-4082-9316-3a8dae7719f7 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:30.848447 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 70/138] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:30.854029 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f96a-6f04-4657-ad83-e419742912eb None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:30.854551 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f96a-6f04-4657-ad83-e419742912eb None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:30.855119 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76f96a-6f04-4657-ad83-e419742912eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:30.873920 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-ab76f96a-6f04-4657-ad83-e419742912eb None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:30.875459 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-ab76f96a-6f04-4657-ad83-e419742912eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:30.948547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 69/139] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:32:31.300809 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6feaf0-7997-4082-9316-3a8dae7719f7 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:31.412614 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6feaf0-7997-4082-9316-3a8dae7719f7 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:31.434868 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:31.454016 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d20f1b-6f5b-43e7-ab5d-83d455621711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:31.454936 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d20f1b-6f5b-43e7-ab5d-83d455621711 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:31.455418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d20f1b-6f5b-43e7-ab5d-83d455621711 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:31.455893 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d20f1b-6f5b-43e7-ab5d-83d455621711 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:31.457361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d20f1b-6f5b-43e7-ab5d-83d455621711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:31.459018 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d20f1b-6f5b-43e7-ab5d-83d455621711 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:31.461167 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 71/140] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:31.467435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76f96a-6f04-4657-ad83-e419742912eb None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:31.499565 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:31.594035 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76f96a-6f04-4657-ad83-e419742912eb None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:31.629299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e3d1d-cadd-408a-9db2-5a70253b96ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:31.629923 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e3d1d-cadd-408a-9db2-5a70253b96ea None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:31.630204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e3d1d-cadd-408a-9db2-5a70253b96ea None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:31.630478 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e3d1d-cadd-408a-9db2-5a70253b96ea None admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:31.631137 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e3d1d-cadd-408a-9db2-5a70253b96ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:31.632613 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e3d1d-cadd-408a-9db2-5a70253b96ea None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:31.657988 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 70/141] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Sep 24 20:32:31 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:32:31.938896 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4362e44-87ee-4812-88c1-ea1a226dfef8 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:31.939442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4362e44-87ee-4812-88c1-ea1a226dfef8 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:31.939865 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4362e44-87ee-4812-88c1-ea1a226dfef8 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:31.941617 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 72/142] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:31.946569 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c708f07-202f-4e22-8790-a22fe690ceb0 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:31.947082 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c708f07-202f-4e22-8790-a22fe690ceb0 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:31.947634 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c708f07-202f-4e22-8790-a22fe690ceb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:31.968480 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-3c708f07-202f-4e22-8790-a22fe690ceb0 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:31.969989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-3c708f07-202f-4e22-8790-a22fe690ceb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:32.045580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee31eeb-b72e-4552-881d-2a86eadfa2cc None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:32.046212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee31eeb-b72e-4552-881d-2a86eadfa2cc None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:32.046691 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee31eeb-b72e-4552-881d-2a86eadfa2cc None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:32.048304 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 73/143] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:32:32.054075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a586ed-4f0d-4691-aa06-1147c145e326 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:32.055256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a586ed-4f0d-4691-aa06-1147c145e326 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:32.055256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a586ed-4f0d-4691-aa06-1147c145e326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:32.072676 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 71/144] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:32.085027 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-80a586ed-4f0d-4691-aa06-1147c145e326 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:32.086506 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-80a586ed-4f0d-4691-aa06-1147c145e326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:32.181350 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 74/145] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:32:32.468767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c708f07-202f-4e22-8790-a22fe690ceb0 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:32.483728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:32.596928 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c708f07-202f-4e22-8790-a22fe690ceb0 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:32.637232 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9feec-7b90-47a6-9c9f-8267ab4bec4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:32.638282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9feec-7b90-47a6-9c9f-8267ab4bec4d None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:32.638768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9feec-7b90-47a6-9c9f-8267ab4bec4d None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:32.639233 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9feec-7b90-47a6-9c9f-8267ab4bec4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:32.653255 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9feec-7b90-47a6-9c9f-8267ab4bec4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:32.658385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-a2a9feec-7b90-47a6-9c9f-8267ab4bec4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:32.658385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:32.658385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:32.658385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:32.658385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:32.658385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:32.658385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:32.658385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:32.658385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:32.658385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:32.658385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:32.658385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:32.658385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:32.658385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:32.658385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:32.658385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:32.659307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:32.659307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:32.659307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:32.659307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:32.659307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:32.659307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:32.659307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:32.659307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:32.659307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:32.659307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:32.659307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:32.659307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:32.659307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:32.659307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:32.659307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:32.659307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:32.660053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:32.660053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:32.660053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:32.660053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:32.660053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:32.660053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:32.660053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:32.660053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:32.660053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:32.660053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:32.660053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:32.660053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:32.662407 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 72/146] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:32.662993 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a586ed-4f0d-4691-aa06-1147c145e326 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:32.668950 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9feec-7b90-47a6-9c9f-8267ab4bec4d None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:32.796286 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:32.841404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a586ed-4f0d-4691-aa06-1147c145e326 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:32.864078 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9feec-7b90-47a6-9c9f-8267ab4bec4d None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:32.872702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:32.903364 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cadd7-be29-41b8-8700-331f28fe88fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:32.904147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cadd7-be29-41b8-8700-331f28fe88fe None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:32.904446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cadd7-be29-41b8-8700-331f28fe88fe None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:32.905811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773cadd7-be29-41b8-8700-331f28fe88fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:32.928637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773cadd7-be29-41b8-8700-331f28fe88fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:32.934012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-773cadd7-be29-41b8-8700-331f28fe88fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:32:32.934012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:32.934012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:32.934012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:32.934012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:32.934012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:32.934012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:32.934012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:32.934012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:32.934012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:32.934012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:32.934012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:32.934012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:32.934012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:32.934012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:32.934012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:32.934853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:32.934853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:32.934853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:32.934853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:32.934853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:32.934853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:32.934853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:32.934853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:32.934853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:32.934853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:32.934853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:32.934853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:32.934853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:32.934853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:32.934853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:32.934853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:32.935621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:32.935621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:32.935621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:32.935621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:32.935621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:32.935621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:32.935621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:32.935621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:32.935621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:32.935621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:32.935621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:32:32.935621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:32.936712 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0629240-0ba1-4168-a014-d2edf79eeb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:32.940375 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0629240-0ba1-4168-a014-d2edf79eeb8e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:32.940375 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0629240-0ba1-4168-a014-d2edf79eeb8e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:32.940375 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0629240-0ba1-4168-a014-d2edf79eeb8e None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:32.940375 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0629240-0ba1-4168-a014-d2edf79eeb8e None admin] RBAC: Adding query filter params (name=member) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:32.940375 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0629240-0ba1-4168-a014-d2edf79eeb8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:32.940716 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0629240-0ba1-4168-a014-d2edf79eeb8e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:32.944495 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 75/147] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:32.945452 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cadd7-be29-41b8-8700-331f28fe88fe None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:32.950103 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 73/148] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:32.957292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0629240-0ba1-4168-a014-d2edf79eeb8e None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:33.151607 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0629240-0ba1-4168-a014-d2edf79eeb8e None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:33.174983 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773cadd7-be29-41b8-8700-331f28fe88fe None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:33.203466 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:33.213058 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2e005-052e-407f-8c63-b208128198fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:33.214254 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2e005-052e-407f-8c63-b208128198fc None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:33.214597 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2e005-052e-407f-8c63-b208128198fc None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:33.214871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2e005-052e-407f-8c63-b208128198fc None admin] PATH_INFO: `/v3/users/f016f79c903d413f83435d4998194d74` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:33.216158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2e005-052e-407f-8c63-b208128198fc None admin] RBAC: Authorizing `identity:get_user(user_id=f016f79c903d413f83435d4998194d74)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:33.217646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2e005-052e-407f-8c63-b208128198fc None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:33.219522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 74/149] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:32 2022] GET /identity/v3/users/f016f79c903d413f83435d4998194d74 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:33.224867 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2e005-052e-407f-8c63-b208128198fc None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:33.301231 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e635152-5f20-4508-80e4-62e757a277d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:33.301870 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e635152-5f20-4508-80e4-62e757a277d3 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:33.302151 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e635152-5f20-4508-80e4-62e757a277d3 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:33.302427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e635152-5f20-4508-80e4-62e757a277d3 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:33.303107 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e635152-5f20-4508-80e4-62e757a277d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:33.303481 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e635152-5f20-4508-80e4-62e757a277d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:33.304969 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e635152-5f20-4508-80e4-62e757a277d3 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:33.321304 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 76/150] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:33.343572 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e635152-5f20-4508-80e4-62e757a277d3 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:33.371559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2e005-052e-407f-8c63-b208128198fc None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:33.425075 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e9d91-09ca-4473-821c-bfa1228f5693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:33.425707 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9d91-09ca-4473-821c-bfa1228f5693 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:33.425989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9d91-09ca-4473-821c-bfa1228f5693 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:33.426096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:33.426261 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9d91-09ca-4473-821c-bfa1228f5693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:33.498479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e635152-5f20-4508-80e4-62e757a277d3 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:33.525991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:33.532832 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e9d91-09ca-4473-821c-bfa1228f5693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:33.534636 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e9d91-09ca-4473-821c-bfa1228f5693 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:33.536952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d00d2-fd41-4827-b132-c163d3eedcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:33.537655 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d00d2-fd41-4827-b132-c163d3eedcae None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:33.537943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d00d2-fd41-4827-b132-c163d3eedcae None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:33.538274 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d00d2-fd41-4827-b132-c163d3eedcae None admin] PATH_INFO: `/v3/users/664bd13e952b45c0bc6d0a00900ede34` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:33.540191 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d00d2-fd41-4827-b132-c163d3eedcae None admin] RBAC: Authorizing `identity:get_user(user_id=664bd13e952b45c0bc6d0a00900ede34)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:33.541660 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d00d2-fd41-4827-b132-c163d3eedcae None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:33.543838 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 77/151] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:33 2022] GET /identity/v3/users/664bd13e952b45c0bc6d0a00900ede34 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:33.550061 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d00d2-fd41-4827-b132-c163d3eedcae None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:33.660372 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d00d2-fd41-4827-b132-c163d3eedcae None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:33.672693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:33.685887 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 75/152] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 20:32:33.690198 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321366-f4de-4118-9808-0aba452313a3 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:33.690483 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321366-f4de-4118-9808-0aba452313a3 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:33.690756 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321366-f4de-4118-9808-0aba452313a3 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:33.692303 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 76/153] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:32:33.696748 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25321366-f4de-4118-9808-0aba452313a3 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:33.699552 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd75730-b309-4e7b-9ef3-86e82d2e2387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:33.700264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd75730-b309-4e7b-9ef3-86e82d2e2387 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:33.700632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd75730-b309-4e7b-9ef3-86e82d2e2387 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:33.700879 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd75730-b309-4e7b-9ef3-86e82d2e2387 None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:33.703135 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd75730-b309-4e7b-9ef3-86e82d2e2387 None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:33.704707 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd75730-b309-4e7b-9ef3-86e82d2e2387 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:33.706422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 78/154] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:33 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:33.710993 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a6a6e-2baf-410a-8c2c-f692bc1ae0c6 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:33.711282 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a6a6e-2baf-410a-8c2c-f692bc1ae0c6 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:33.711565 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a6a6e-2baf-410a-8c2c-f692bc1ae0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:33.746731 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-a83a6a6e-2baf-410a-8c2c-f692bc1ae0c6 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:33.747981 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-a83a6a6e-2baf-410a-8c2c-f692bc1ae0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:33.838015 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:33.841116 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25321366-f4de-4118-9808-0aba452313a3 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:33.858368 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 79/155] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:33.859294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a6a6e-2baf-410a-8c2c-f692bc1ae0c6 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:33.896949 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7781d-7762-4539-917d-17c29af2b29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:33.900456 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7781d-7762-4539-917d-17c29af2b29c None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:33.900812 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7781d-7762-4539-917d-17c29af2b29c None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:33.901091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7781d-7762-4539-917d-17c29af2b29c None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:33.904496 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7781d-7762-4539-917d-17c29af2b29c None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:33.906035 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7781d-7762-4539-917d-17c29af2b29c None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:33.907742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 77/156] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:33 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:33.914392 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7781d-7762-4539-917d-17c29af2b29c None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:34.029882 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a6a6e-2baf-410a-8c2c-f692bc1ae0c6 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:34.040773 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:34.098778 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085f831-1d50-4909-a422-35d6976de93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:34.099444 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085f831-1d50-4909-a422-35d6976de93f None admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:34.099722 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085f831-1d50-4909-a422-35d6976de93f None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:34.099994 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085f831-1d50-4909-a422-35d6976de93f None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa/users/664bd13e952b45c0bc6d0a00900ede34/roles/11b3648aadfb4d19b376c5acc9465a44` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:34.103881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085f831-1d50-4909-a422-35d6976de93f None admin] RBAC: Authorizing `identity:create_grant(project_id=0acc8c7eebf94a958818fae44bb2a0aa, user_id=664bd13e952b45c0bc6d0a00900ede34, role_id=11b3648aadfb4d19b376c5acc9465a44)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:34.106592 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085f831-1d50-4909-a422-35d6976de93f None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:34.113403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7781d-7762-4539-917d-17c29af2b29c None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:34.130352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 80/157] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Sep 24 20:32:33 2022] PUT /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa/users/664bd13e952b45c0bc6d0a00900ede34/roles/11b3648aadfb4d19b376c5acc9465a44 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:32:34.172935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d944c1-f904-464c-8337-7c3a33fbefaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:34.173560 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d944c1-f904-464c-8337-7c3a33fbefaa None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:34.173838 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d944c1-f904-464c-8337-7c3a33fbefaa None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:34.174113 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d944c1-f904-464c-8337-7c3a33fbefaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:34.174844 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d944c1-f904-464c-8337-7c3a33fbefaa None admin] RBAC: Adding query filter params (role.id=3481273c76dc4a20b3f73c4f8ea558e6, scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa, user.id=f016f79c903d413f83435d4998194d74) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:34.175151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d944c1-f904-464c-8337-7c3a33fbefaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:34.178455 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d944c1-f904-464c-8337-7c3a33fbefaa None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:34.188375 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 78/158] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:33 2022] GET /identity/v3/role_assignments?user.id=f016f79c903d413f83435d4998194d74&scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa&role.id=3481273c76dc4a20b3f73c4f8ea558e6 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:34.207955 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc509e-27bb-442c-a2c3-488335187a16 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:34.208314 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc509e-27bb-442c-a2c3-488335187a16 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:34.208620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc509e-27bb-442c-a2c3-488335187a16 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:34.210165 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 81/159] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:34.222376 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76493f4-b232-4a17-b35f-4147c7f97485 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:34.222676 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76493f4-b232-4a17-b35f-4147c7f97485 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:34.222931 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76493f4-b232-4a17-b35f-4147c7f97485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:34.244856 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-e76493f4-b232-4a17-b35f-4147c7f97485 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:34.246636 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-e76493f4-b232-4a17-b35f-4147c7f97485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:34.276487 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:34.326816 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 79/160] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:34.579330 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc509e-27bb-442c-a2c3-488335187a16 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:34.706175 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc509e-27bb-442c-a2c3-488335187a16 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:34.744256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb3cf9-a3c7-4fd8-8bfa-591afe093ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:34.744921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb3cf9-a3c7-4fd8-8bfa-591afe093ec8 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:34.745202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb3cf9-a3c7-4fd8-8bfa-591afe093ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:34.745541 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb3cf9-a3c7-4fd8-8bfa-591afe093ec8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:34.756633 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb3cf9-a3c7-4fd8-8bfa-591afe093ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:34.763158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-f0bb3cf9-a3c7-4fd8-8bfa-591afe093ec8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:34.763158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:34.763158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:34.763158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:34.763158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:34.763158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:34.763158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:34.763158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:34.763158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:34.763158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:34.763158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:34.763158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:34.763158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:34.763158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:34.763158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:34.763158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:34.764114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:34.764114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:34.764114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:34.764114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:34.764114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:34.764114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:34.764114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:34.764114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:34.764114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:34.764114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:34.764114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:34.764114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:34.764114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:34.764114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:34.764114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:34.764114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:34.764931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:34.764931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:34.764931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:34.764931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:34.764931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:34.764931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:34.764931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:34.764931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:34.764931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:34.764931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:34.764931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:34.764931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:34.764931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 82/161] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:34.772686 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76493f4-b232-4a17-b35f-4147c7f97485 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:34.893736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76493f4-b232-4a17-b35f-4147c7f97485 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:34.936443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed76a4a-dae8-43c9-97f2-e27d91fd3c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:34.937072 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed76a4a-dae8-43c9-97f2-e27d91fd3c6b None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:34.937352 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed76a4a-dae8-43c9-97f2-e27d91fd3c6b None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:34.937626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed76a4a-dae8-43c9-97f2-e27d91fd3c6b None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:34.938300 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed76a4a-dae8-43c9-97f2-e27d91fd3c6b None admin] RBAC: Adding query filter params (name=member) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:34.938605 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed76a4a-dae8-43c9-97f2-e27d91fd3c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:34.939981 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed76a4a-dae8-43c9-97f2-e27d91fd3c6b None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:34.949319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 80/162] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:34.954901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb3cf9-a3c7-4fd8-8bfa-591afe093ec8 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:34.986075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:35.070061 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb3cf9-a3c7-4fd8-8bfa-591afe093ec8 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:35.109030 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da7d9f-ad4a-487c-8030-6979d4085f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:35.109671 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da7d9f-ad4a-487c-8030-6979d4085f11 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:35.110256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da7d9f-ad4a-487c-8030-6979d4085f11 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:35.110532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da7d9f-ad4a-487c-8030-6979d4085f11 None admin] PATH_INFO: `/v3/users/f016f79c903d413f83435d4998194d74` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:35.111750 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da7d9f-ad4a-487c-8030-6979d4085f11 None admin] RBAC: Authorizing `identity:get_user(user_id=f016f79c903d413f83435d4998194d74)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:35.113224 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da7d9f-ad4a-487c-8030-6979d4085f11 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:35.115112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 83/163] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:34 2022] GET /identity/v3/users/f016f79c903d413f83435d4998194d74 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:35.120677 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed76a4a-dae8-43c9-97f2-e27d91fd3c6b None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:35.152661 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:35.169228 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da7d9f-ad4a-487c-8030-6979d4085f11 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:35.297467 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed76a4a-dae8-43c9-97f2-e27d91fd3c6b None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:35.348724 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:35.364451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700dc0e-304f-486e-815b-5515625c7129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:35.365330 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700dc0e-304f-486e-815b-5515625c7129 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:35.365330 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700dc0e-304f-486e-815b-5515625c7129 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:35.365604 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700dc0e-304f-486e-815b-5515625c7129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:35.366343 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da7d9f-ad4a-487c-8030-6979d4085f11 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:35.432158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea6fc8-58a6-44ad-a1e3-8d5f0082da02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:35.432853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea6fc8-58a6-44ad-a1e3-8d5f0082da02 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:35.433170 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea6fc8-58a6-44ad-a1e3-8d5f0082da02 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:35.433443 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea6fc8-58a6-44ad-a1e3-8d5f0082da02 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:35.458983 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea6fc8-58a6-44ad-a1e3-8d5f0082da02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:35.464485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-efea6fc8-58a6-44ad-a1e3-8d5f0082da02 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:32:35.464485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:35.464485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:35.464485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:35.464485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:35.464485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:35.464485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:35.464485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:35.464485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:35.464485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:35.464485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:35.464485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:35.464485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:35.464485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:35.464485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:35.464485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:35.465361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:35.465361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:35.465361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:35.465361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:35.465361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:35.465361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:35.465361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:35.465361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:35.465361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:35.465361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:35.465361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:35.465361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:35.465361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:35.465361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:35.465361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:35.465361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:35.466137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:35.466137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:35.466137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:35.466137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:35.466137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:35.466137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:35.466137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:35.466137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:35.466137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:35.466137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:35.466137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:32:35.466137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:35.466137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 84/164] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:32:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:35.467471 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3231-2eae-4d30-976e-d09dbd7c2565 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:35.467471 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3231-2eae-4d30-976e-d09dbd7c2565 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:35.467636 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa3231-2eae-4d30-976e-d09dbd7c2565 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:35.476363 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 85/165] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:35.488766 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068350d-1d1d-4056-b25f-4b7c0bd965ca None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:35.489247 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068350d-1d1d-4056-b25f-4b7c0bd965ca None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:35.489646 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068350d-1d1d-4056-b25f-4b7c0bd965ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:35.507973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700dc0e-304f-486e-815b-5515625c7129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:35.509842 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700dc0e-304f-486e-815b-5515625c7129 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:35.510382 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-a068350d-1d1d-4056-b25f-4b7c0bd965ca None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:35.512498 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-a068350d-1d1d-4056-b25f-4b7c0bd965ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:35.557756 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:35.650854 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 86/166] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:35.651539 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068350d-1d1d-4056-b25f-4b7c0bd965ca None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:35.719164 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 81/167] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:32:35.726276 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700dc0e-304f-486e-815b-5515625c7129 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:35.803367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:35.842480 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068350d-1d1d-4056-b25f-4b7c0bd965ca None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:35.929950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706d77d-76d5-486e-831f-3e1942b50627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:35.930806 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706d77d-76d5-486e-831f-3e1942b50627 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:35.931225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706d77d-76d5-486e-831f-3e1942b50627 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:35.931639 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706d77d-76d5-486e-831f-3e1942b50627 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:35.932545 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706d77d-76d5-486e-831f-3e1942b50627 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:35.933539 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706d77d-76d5-486e-831f-3e1942b50627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:35.935047 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706d77d-76d5-486e-831f-3e1942b50627 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:35.952449 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 87/168] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:32:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:35.957924 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706d77d-76d5-486e-831f-3e1942b50627 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:35.959337 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700dc0e-304f-486e-815b-5515625c7129 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:35.997916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:36.019461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba69823-b9c7-4211-b124-b699c8027862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:36.020197 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69823-b9c7-4211-b124-b699c8027862 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:36.020692 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69823-b9c7-4211-b124-b699c8027862 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:36.021033 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba69823-b9c7-4211-b124-b699c8027862 None admin] PATH_INFO: `/v3/projects/a53edf5aef454c5b8f94639be0993091` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:36.024785 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba69823-b9c7-4211-b124-b699c8027862 None admin] RBAC: Authorizing `identity:get_project(project_id=a53edf5aef454c5b8f94639be0993091)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:36.026369 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba69823-b9c7-4211-b124-b699c8027862 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:36.028190 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 82/169] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:35 2022] GET /identity/v3/projects/a53edf5aef454c5b8f94639be0993091 => generated 312 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:36.036356 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba69823-b9c7-4211-b124-b699c8027862 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:36.178471 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706d77d-76d5-486e-831f-3e1942b50627 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:36.215368 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba69823-b9c7-4211-b124-b699c8027862 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:36.256387 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f7e0f-7572-4148-98a6-9f48c482cdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:36.256940 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f7e0f-7572-4148-98a6-9f48c482cdad None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:36.257221 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f7e0f-7572-4148-98a6-9f48c482cdad None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:36.257502 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f7e0f-7572-4148-98a6-9f48c482cdad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:36.258340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f7e0f-7572-4148-98a6-9f48c482cdad None admin] RBAC: Adding query filter params (role.id=3481273c76dc4a20b3f73c4f8ea558e6, scope.project.id=a53edf5aef454c5b8f94639be0993091, user.id=f016f79c903d413f83435d4998194d74) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:36.258653 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f7e0f-7572-4148-98a6-9f48c482cdad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:36.260083 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f7e0f-7572-4148-98a6-9f48c482cdad None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:36.267148 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 83/170] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:36 2022] GET /identity/v3/role_assignments?user.id=f016f79c903d413f83435d4998194d74&scope.project.id=a53edf5aef454c5b8f94639be0993091&role.id=3481273c76dc4a20b3f73c4f8ea558e6 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:36.277340 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4a3ba-09cf-4f1a-88b3-5d93e6970f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:36.278242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4a3ba-09cf-4f1a-88b3-5d93e6970f0e None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:36.278659 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4a3ba-09cf-4f1a-88b3-5d93e6970f0e None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:36.279086 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4a3ba-09cf-4f1a-88b3-5d93e6970f0e None admin] PATH_INFO: `/v3/users/f016f79c903d413f83435d4998194d74` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:36.285256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4a3ba-09cf-4f1a-88b3-5d93e6970f0e None admin] RBAC: Authorizing `identity:get_user(user_id=f016f79c903d413f83435d4998194d74)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:36.287048 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4a3ba-09cf-4f1a-88b3-5d93e6970f0e None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:36.288889 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 88/171] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:35 2022] GET /identity/v3/users/f016f79c903d413f83435d4998194d74 => generated 275 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:36.295323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f7e0f-7572-4148-98a6-9f48c482cdad None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:36.376524 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:36.429287 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f7e0f-7572-4148-98a6-9f48c482cdad None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:36.445549 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4a3ba-09cf-4f1a-88b3-5d93e6970f0e None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:36.467014 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daaa735-75eb-4f23-8e2f-51b28dc1955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:36.467641 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaa735-75eb-4f23-8e2f-51b28dc1955a None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:36.467925 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaa735-75eb-4f23-8e2f-51b28dc1955a None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:36.468201 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaa735-75eb-4f23-8e2f-51b28dc1955a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:36.489798 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:36.554014 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daaa735-75eb-4f23-8e2f-51b28dc1955a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:36.555424 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daaa735-75eb-4f23-8e2f-51b28dc1955a None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:36.616708 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:36.668853 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 84/172] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:32:36.675479 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daaa735-75eb-4f23-8e2f-51b28dc1955a None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:36.712547 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4a3ba-09cf-4f1a-88b3-5d93e6970f0e None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:36.803959 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972ac94-4ca8-4f52-8fbf-fb575c3659f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:36.805456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972ac94-4ca8-4f52-8fbf-fb575c3659f8 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:36.805952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972ac94-4ca8-4f52-8fbf-fb575c3659f8 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:36.806417 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972ac94-4ca8-4f52-8fbf-fb575c3659f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:36.820060 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daaa735-75eb-4f23-8e2f-51b28dc1955a None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:36.841340 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972ac94-4ca8-4f52-8fbf-fb575c3659f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:36.846367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-a972ac94-4ca8-4f52-8fbf-fb575c3659f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:36.846367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:36.846367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:36.846367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:36.846367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:36.846367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:36.846367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:36.846367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:36.846367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:36.846367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:36.846367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:36.846367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:36.846367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:36.846367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:36.846367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:36.846367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:36.847410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:36.847410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:36.847410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:36.847410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:36.847410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:36.847410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:36.847410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:36.847410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:36.847410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:36.847410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:36.847410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:36.847410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:36.847410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:36.847410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:36.847410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:36.847410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:36.848188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:36.848188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:36.848188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:36.848188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:36.848188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:36.848188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:36.848188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:36.848188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:36.848188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:36.848188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:36.848188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:36.848188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:36.848188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 89/173] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:32:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:36.854014 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972ac94-4ca8-4f52-8fbf-fb575c3659f8 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:36.861565 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795bd94-d1e9-4c0f-b144-500908c59ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:36.862475 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795bd94-d1e9-4c0f-b144-500908c59ee8 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:36.862950 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795bd94-d1e9-4c0f-b144-500908c59ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:36.863411 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795bd94-d1e9-4c0f-b144-500908c59ee8 None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:36.864826 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795bd94-d1e9-4c0f-b144-500908c59ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:36.866457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795bd94-d1e9-4c0f-b144-500908c59ee8 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:36.868278 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 85/174] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:36 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:36.874304 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795bd94-d1e9-4c0f-b144-500908c59ee8 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:36.901706 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:36.986411 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795bd94-d1e9-4c0f-b144-500908c59ee8 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:37.020709 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:37.024119 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b54bf-dc6b-49aa-8668-3c768bf5e2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:37.024959 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b54bf-dc6b-49aa-8668-3c768bf5e2a9 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:37.025416 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b54bf-dc6b-49aa-8668-3c768bf5e2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:37.025884 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b54bf-dc6b-49aa-8668-3c768bf5e2a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:37.026903 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b54bf-dc6b-49aa-8668-3c768bf5e2a9 None admin] RBAC: Adding query filter params (role.id=905829118b764aa9920810cb3b86e0ce, scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa, user.id=f016f79c903d413f83435d4998194d74) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:37.027430 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b54bf-dc6b-49aa-8668-3c768bf5e2a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:37.029254 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b54bf-dc6b-49aa-8668-3c768bf5e2a9 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:37.035792 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 86/175] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:36 2022] GET /identity/v3/role_assignments?user.id=f016f79c903d413f83435d4998194d74&scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa&role.id=905829118b764aa9920810cb3b86e0ce => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:37.037293 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49b156-0885-492c-baaf-e85441959486 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:37.037754 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49b156-0885-492c-baaf-e85441959486 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:37.038199 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49b156-0885-492c-baaf-e85441959486 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:37.039558 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 87/176] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:37.047408 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febe004-f55d-40da-b66a-c900c8355a14 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:37.047986 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febe004-f55d-40da-b66a-c900c8355a14 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:37.048519 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febe004-f55d-40da-b66a-c900c8355a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:37.058789 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972ac94-4ca8-4f52-8fbf-fb575c3659f8 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:37.072474 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-5febe004-f55d-40da-b66a-c900c8355a14 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:37.074584 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-5febe004-f55d-40da-b66a-c900c8355a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:37.120363 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d633ab0-5ea9-49ed-a044-7bed547dd29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:37.120363 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d633ab0-5ea9-49ed-a044-7bed547dd29b None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:37.120363 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d633ab0-5ea9-49ed-a044-7bed547dd29b None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:37.120363 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d633ab0-5ea9-49ed-a044-7bed547dd29b None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:37.120764 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d633ab0-5ea9-49ed-a044-7bed547dd29b None admin] RBAC: Adding query filter params (name=admin) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:37.120764 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d633ab0-5ea9-49ed-a044-7bed547dd29b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:37.120764 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d633ab0-5ea9-49ed-a044-7bed547dd29b None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:37.130481 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 90/177] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:37.136929 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d633ab0-5ea9-49ed-a044-7bed547dd29b None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:37.190579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 88/178] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:37.211333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d467b-85ec-4454-ad21-138d48bd5feb None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:37.211897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d467b-85ec-4454-ad21-138d48bd5feb None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:37.212370 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d467b-85ec-4454-ad21-138d48bd5feb None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:37.213905 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 89/179] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:32:37.239194 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694f6bf-249c-4d78-a3bd-b6696b851187 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:37.239858 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694f6bf-249c-4d78-a3bd-b6696b851187 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:37.240356 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694f6bf-249c-4d78-a3bd-b6696b851187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:37.262892 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-9694f6bf-249c-4d78-a3bd-b6696b851187 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:37.264500 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-9694f6bf-249c-4d78-a3bd-b6696b851187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:37.280822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:37.347594 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d633ab0-5ea9-49ed-a044-7bed547dd29b None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:37.395079 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 90/180] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:37.417218 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe24c2-ed8a-48b0-80b8-86fb82ac1cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:37.418290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe24c2-ed8a-48b0-80b8-86fb82ac1cb2 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:37.418772 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe24c2-ed8a-48b0-80b8-86fb82ac1cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:37.419255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe24c2-ed8a-48b0-80b8-86fb82ac1cb2 None admin] PATH_INFO: `/v3/users/9f6d7830fd8e4f16950273e6f89f703c` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:37.420617 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe24c2-ed8a-48b0-80b8-86fb82ac1cb2 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6d7830fd8e4f16950273e6f89f703c)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:37.422306 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe24c2-ed8a-48b0-80b8-86fb82ac1cb2 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:37.424509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 91/181] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:37 2022] GET /identity/v3/users/9f6d7830fd8e4f16950273e6f89f703c => generated 247 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:37.430403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694f6bf-249c-4d78-a3bd-b6696b851187 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:37.564583 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694f6bf-249c-4d78-a3bd-b6696b851187 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:37.606331 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524ef01-9b79-43b7-ba9a-f8a3f0e53e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:37.607263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524ef01-9b79-43b7-ba9a-f8a3f0e53e21 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:37.607741 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524ef01-9b79-43b7-ba9a-f8a3f0e53e21 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:37.608208 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524ef01-9b79-43b7-ba9a-f8a3f0e53e21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:37.633280 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:37.694543 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe24c2-ed8a-48b0-80b8-86fb82ac1cb2 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:37.703232 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524ef01-9b79-43b7-ba9a-f8a3f0e53e21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:37.704965 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524ef01-9b79-43b7-ba9a-f8a3f0e53e21 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:37.705564 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:37.861490 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 91/182] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:32:37.862462 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe24c2-ed8a-48b0-80b8-86fb82ac1cb2 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:37.862905 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e15b1-a5d2-40ba-93ee-b903f836bb40 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:37.863026 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e15b1-a5d2-40ba-93ee-b903f836bb40 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:37.863506 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e15b1-a5d2-40ba-93ee-b903f836bb40 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:37.865139 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 92/183] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:37.873651 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8ac38-86c7-49f0-9046-9dff8d24f6ec None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:37.874165 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8ac38-86c7-49f0-9046-9dff8d24f6ec None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:37.874617 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8ac38-86c7-49f0-9046-9dff8d24f6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:37.900668 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-b8e8ac38-86c7-49f0-9046-9dff8d24f6ec None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:37.902260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-b8e8ac38-86c7-49f0-9046-9dff8d24f6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:37.908316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29371d33-3cff-4998-92ab-251de9305678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:37.908993 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29371d33-3cff-4998-92ab-251de9305678 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:37.909273 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29371d33-3cff-4998-92ab-251de9305678 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:37.909550 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29371d33-3cff-4998-92ab-251de9305678 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:37.921624 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29371d33-3cff-4998-92ab-251de9305678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:37.928465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-29371d33-3cff-4998-92ab-251de9305678 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:37.928465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:37.928465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:37.928465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:37.928465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:37.928465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:37.928465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:37.928465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:37.928465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:37.928465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:37.928465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:37.928465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:37.928465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:37.928465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:37.928465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:37.928465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:37.929362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:37.929362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:37.929362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:37.929362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:37.929362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:37.929362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:37.929362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:37.929362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:37.929362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:37.929362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:37.929362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:37.929362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:37.929362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:37.929362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:37.929362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:37.929362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:37.930198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:37.930198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:37.930198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:37.930198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:37.930198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:37.930198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:37.930198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:37.930198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:37.930198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:37.930198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:37.930198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:37.930198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:37.930198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 92/184] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:32:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:32:37.930839 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29371d33-3cff-4998-92ab-251de9305678 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:37.955715 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:37.984707 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 93/185] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:37.985795 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8ac38-86c7-49f0-9046-9dff8d24f6ec None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:38.009235 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:38.055455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29371d33-3cff-4998-92ab-251de9305678 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:38.096719 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8ac38-86c7-49f0-9046-9dff8d24f6ec None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:38.104929 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31a5fe-9611-4389-9ef1-3528834168c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:38.105631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31a5fe-9611-4389-9ef1-3528834168c9 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:38.105926 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31a5fe-9611-4389-9ef1-3528834168c9 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:38.106720 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31a5fe-9611-4389-9ef1-3528834168c9 None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:38.107887 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31a5fe-9611-4389-9ef1-3528834168c9 None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:38.109835 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31a5fe-9611-4389-9ef1-3528834168c9 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:38.112358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 93/186] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:37 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:38.113141 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31a5fe-9611-4389-9ef1-3528834168c9 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:38.142834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b32f0-61be-4351-9326-b25e61a52929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:38.143756 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b32f0-61be-4351-9326-b25e61a52929 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:38.144211 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b32f0-61be-4351-9326-b25e61a52929 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:38.144706 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b32f0-61be-4351-9326-b25e61a52929 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:38.146086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b32f0-61be-4351-9326-b25e61a52929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:38.147696 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b32f0-61be-4351-9326-b25e61a52929 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:38.149628 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 94/187] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:38.155420 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b32f0-61be-4351-9326-b25e61a52929 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:38.230355 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:38.262217 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31a5fe-9611-4389-9ef1-3528834168c9 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:38.294637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:38.295077 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b32f0-61be-4351-9326-b25e61a52929 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:38.300809 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecbb90-9cb6-4de5-9478-e23b3a4ef324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:38.301794 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecbb90-9cb6-4de5-9478-e23b3a4ef324 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:38.302142 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecbb90-9cb6-4de5-9478-e23b3a4ef324 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:38.302485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecbb90-9cb6-4de5-9478-e23b3a4ef324 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:38.303216 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecbb90-9cb6-4de5-9478-e23b3a4ef324 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:38.303589 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecbb90-9cb6-4de5-9478-e23b3a4ef324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:38.305054 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecbb90-9cb6-4de5-9478-e23b3a4ef324 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:38.315384 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 94/188] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:38.316290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecbb90-9cb6-4de5-9478-e23b3a4ef324 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:38.337881 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd6fe2-08e9-4f58-bfe5-688e8dbdf982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:38.338874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd6fe2-08e9-4f58-bfe5-688e8dbdf982 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:38.339343 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd6fe2-08e9-4f58-bfe5-688e8dbdf982 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:38.339787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd6fe2-08e9-4f58-bfe5-688e8dbdf982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:38.340853 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd6fe2-08e9-4f58-bfe5-688e8dbdf982 None admin] RBAC: Adding query filter params (role.id=9cc90aa0ccde4b75b7642101cbf45cf2, scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa, user.id=9f6d7830fd8e4f16950273e6f89f703c) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:38.341344 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd6fe2-08e9-4f58-bfe5-688e8dbdf982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:38.343016 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd6fe2-08e9-4f58-bfe5-688e8dbdf982 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:38.349647 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 95/189] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:38 2022] GET /identity/v3/role_assignments?user.id=9f6d7830fd8e4f16950273e6f89f703c&scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa&role.id=9cc90aa0ccde4b75b7642101cbf45cf2 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:38.350681 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd6fe2-08e9-4f58-bfe5-688e8dbdf982 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:38.429594 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecbb90-9cb6-4de5-9478-e23b3a4ef324 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:38.472278 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4d6ef-3a91-4c15-80f4-6b2524849c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:38.473043 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4d6ef-3a91-4c15-80f4-6b2524849c55 None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:38.473396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4d6ef-3a91-4c15-80f4-6b2524849c55 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:38.473743 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4d6ef-3a91-4c15-80f4-6b2524849c55 None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:38.474484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4d6ef-3a91-4c15-80f4-6b2524849c55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:38.476162 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4d6ef-3a91-4c15-80f4-6b2524849c55 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:38.483679 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd6fe2-08e9-4f58-bfe5-688e8dbdf982 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:38.499423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:38.501738 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 95/190] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Sep 24 20:32:38 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:32:38.503085 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4d6ef-3a91-4c15-80f4-6b2524849c55 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:38.551746 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6f2f8-3933-496a-8d1a-45308feec143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:38.552514 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6f2f8-3933-496a-8d1a-45308feec143 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:38.552801 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6f2f8-3933-496a-8d1a-45308feec143 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:38.553077 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6f2f8-3933-496a-8d1a-45308feec143 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:38.569641 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6f2f8-3933-496a-8d1a-45308feec143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:38.578954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-a4c6f2f8-3933-496a-8d1a-45308feec143 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:32:38.578954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:38.578954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:38.578954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:38.578954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:38.578954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:38.578954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:38.578954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:38.578954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:38.578954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:38.578954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:38.578954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:38.578954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:38.578954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:38.578954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:38.578954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:38.579913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:38.579913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:38.579913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:38.579913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:38.579913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:38.579913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:38.579913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:38.579913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:38.579913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:38.579913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:38.579913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:38.579913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:38.579913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:38.579913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:38.579913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:38.579913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:38.581134 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:38.581134 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:38.581134 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:38.581134 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:38.581134 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:38.581134 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:38.581134 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:38.581134 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:38.581134 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:38.581134 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:38.581134 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:32:38.581134 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:38.581134 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 96/191] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:32:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:38.582063 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef693bf-c3b7-43e7-9015-2dd24a7e1217 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:38.582063 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef693bf-c3b7-43e7-9015-2dd24a7e1217 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:38.582063 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef693bf-c3b7-43e7-9015-2dd24a7e1217 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:38.589893 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 97/192] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:38.591891 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db89ee-0556-4080-bf4f-a281c59ef3f9 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:38.592501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db89ee-0556-4080-bf4f-a281c59ef3f9 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:38.592788 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db89ee-0556-4080-bf4f-a281c59ef3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:38.599595 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:38.617124 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-08db89ee-0556-4080-bf4f-a281c59ef3f9 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:38.618498 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-08db89ee-0556-4080-bf4f-a281c59ef3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:38.672101 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4d6ef-3a91-4c15-80f4-6b2524849c55 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:38.707278 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 98/193] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:38.709910 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db89ee-0556-4080-bf4f-a281c59ef3f9 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:38.721949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f3990-176c-4843-8fcf-452af74984c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:38.722808 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f3990-176c-4843-8fcf-452af74984c0 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:38.723159 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f3990-176c-4843-8fcf-452af74984c0 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:38.723510 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f3990-176c-4843-8fcf-452af74984c0 None admin] PATH_INFO: `/v3/users/9b1245c12202439fb26d6b5d4d9105d9` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:38.740750 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f3990-176c-4843-8fcf-452af74984c0 None admin] RBAC: Authorizing `identity:get_user(user_id=9b1245c12202439fb26d6b5d4d9105d9)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:38.742216 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f3990-176c-4843-8fcf-452af74984c0 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:38.743898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 96/194] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:38 2022] GET /identity/v3/users/9b1245c12202439fb26d6b5d4d9105d9 => generated 283 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:38.749980 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f3990-176c-4843-8fcf-452af74984c0 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:38.834338 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:38.840261 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db89ee-0556-4080-bf4f-a281c59ef3f9 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:38.881919 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35508b9-a869-455c-8fb6-c342c2ee1d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:38.882547 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f3990-176c-4843-8fcf-452af74984c0 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:38.882965 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35508b9-a869-455c-8fb6-c342c2ee1d84 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:38.882965 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35508b9-a869-455c-8fb6-c342c2ee1d84 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:38.883220 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35508b9-a869-455c-8fb6-c342c2ee1d84 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:38.883834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35508b9-a869-455c-8fb6-c342c2ee1d84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:38.884139 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35508b9-a869-455c-8fb6-c342c2ee1d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:38.885756 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35508b9-a869-455c-8fb6-c342c2ee1d84 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:38.895603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 99/195] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:32:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:38.897640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:38.902165 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35508b9-a869-455c-8fb6-c342c2ee1d84 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:38.935622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328a83d-0107-49e2-a10a-ef63a41b4b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:38.936276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328a83d-0107-49e2-a10a-ef63a41b4b48 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:38.936583 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328a83d-0107-49e2-a10a-ef63a41b4b48 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:38.937626 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328a83d-0107-49e2-a10a-ef63a41b4b48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:39.024537 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328a83d-0107-49e2-a10a-ef63a41b4b48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:39.026309 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328a83d-0107-49e2-a10a-ef63a41b4b48 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:39.050466 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35508b9-a869-455c-8fb6-c342c2ee1d84 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:39.091020 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b47406-2057-41af-9430-f73b3caa8196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:39.091662 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b47406-2057-41af-9430-f73b3caa8196 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:39.091942 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b47406-2057-41af-9430-f73b3caa8196 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:39.092215 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b47406-2057-41af-9430-f73b3caa8196 None admin] PATH_INFO: `/v3/users/9b1245c12202439fb26d6b5d4d9105d9` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:39.093455 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b47406-2057-41af-9430-f73b3caa8196 None admin] RBAC: Authorizing `identity:get_user(user_id=9b1245c12202439fb26d6b5d4d9105d9)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:39.094914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b47406-2057-41af-9430-f73b3caa8196 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:39.096798 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 100/196] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:38 2022] GET /identity/v3/users/9b1245c12202439fb26d6b5d4d9105d9 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:39.097330 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b47406-2057-41af-9430-f73b3caa8196 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:39.130742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:39.141959 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 97/197] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:32:39.143209 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328a83d-0107-49e2-a10a-ef63a41b4b48 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:39.163872 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:39.236229 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b47406-2057-41af-9430-f73b3caa8196 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:39.278272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec31f9-1955-4988-9810-f45a8733465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:39.278824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec31f9-1955-4988-9810-f45a8733465c None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:39.279105 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec31f9-1955-4988-9810-f45a8733465c None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:39.279381 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec31f9-1955-4988-9810-f45a8733465c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:39.283498 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328a83d-0107-49e2-a10a-ef63a41b4b48 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:39.290314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec31f9-1955-4988-9810-f45a8733465c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:39.296432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-a1ec31f9-1955-4988-9810-f45a8733465c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:32:39.296432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:39.296432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:39.296432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:39.296432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:39.296432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:39.296432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:39.296432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:39.296432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:39.296432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:39.296432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:39.296432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:39.296432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:39.296432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:39.296432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:39.296432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:39.297299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:39.297299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:39.297299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:39.297299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:39.297299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:39.297299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:39.297299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:39.297299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:39.297299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:39.297299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:39.297299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:39.297299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:39.297299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:39.297299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:39.297299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:39.297299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:39.298091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:39.298091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:39.298091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:39.298091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:39.298091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:39.298091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:39.298091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:39.298091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:39.298091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:39.298091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:39.298091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:32:39.298091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:39.298091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 101/198] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:39.298737 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec31f9-1955-4988-9810-f45a8733465c None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:39.324102 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26f9e9-40b6-4d3f-9e5f-b364418d4912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:39.324849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f9e9-40b6-4d3f-9e5f-b364418d4912 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:39.325136 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f9e9-40b6-4d3f-9e5f-b364418d4912 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:39.325411 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26f9e9-40b6-4d3f-9e5f-b364418d4912 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:39.400133 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26f9e9-40b6-4d3f-9e5f-b364418d4912 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:39.401749 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26f9e9-40b6-4d3f-9e5f-b364418d4912 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:39.414650 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:39.417741 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:39.427595 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec31f9-1955-4988-9810-f45a8733465c None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:39.463653 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccae148-9526-4920-a7b7-32cd0eaff3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:39.464925 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccae148-9526-4920-a7b7-32cd0eaff3ea None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:39.465210 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccae148-9526-4920-a7b7-32cd0eaff3ea None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:39.465486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccae148-9526-4920-a7b7-32cd0eaff3ea None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:39.466617 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccae148-9526-4920-a7b7-32cd0eaff3ea None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:39.468119 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccae148-9526-4920-a7b7-32cd0eaff3ea None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:39.470007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 102/199] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:39 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:39.475434 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccae148-9526-4920-a7b7-32cd0eaff3ea None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:39.533421 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 98/200] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:32:39.534479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26f9e9-40b6-4d3f-9e5f-b364418d4912 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:39.582717 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccae148-9526-4920-a7b7-32cd0eaff3ea None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:39.622512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791666e6-7f7d-42e3-9b57-ddedd57adc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:39.622878 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791666e6-7f7d-42e3-9b57-ddedd57adc78 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:39.623158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791666e6-7f7d-42e3-9b57-ddedd57adc78 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:39.623436 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791666e6-7f7d-42e3-9b57-ddedd57adc78 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:39.624295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791666e6-7f7d-42e3-9b57-ddedd57adc78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:39.624652 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791666e6-7f7d-42e3-9b57-ddedd57adc78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:39.626036 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791666e6-7f7d-42e3-9b57-ddedd57adc78 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:39.634698 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 103/201] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:39.635705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791666e6-7f7d-42e3-9b57-ddedd57adc78 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:39.659482 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:39.667390 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26f9e9-40b6-4d3f-9e5f-b364418d4912 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:39.679567 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:39.714761 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf74377-9e9a-452d-9e6d-2510cdaabfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:39.715741 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf74377-9e9a-452d-9e6d-2510cdaabfae None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:39.716216 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf74377-9e9a-452d-9e6d-2510cdaabfae None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:39.716708 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf74377-9e9a-452d-9e6d-2510cdaabfae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:39.717642 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf74377-9e9a-452d-9e6d-2510cdaabfae None admin] RBAC: Adding query filter params (role.id=9cc90aa0ccde4b75b7642101cbf45cf2, scope.project.id=aa98305d5a0d465b98d3f7ad7d883522, user.id=9b1245c12202439fb26d6b5d4d9105d9) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:39.718645 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf74377-9e9a-452d-9e6d-2510cdaabfae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:39.720692 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf74377-9e9a-452d-9e6d-2510cdaabfae None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:39.731197 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 99/202] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:39 2022] GET /identity/v3/role_assignments?user.id=9b1245c12202439fb26d6b5d4d9105d9&scope.project.id=aa98305d5a0d465b98d3f7ad7d883522&role.id=9cc90aa0ccde4b75b7642101cbf45cf2 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:39.731836 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf74377-9e9a-452d-9e6d-2510cdaabfae None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:39.751042 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791666e6-7f7d-42e3-9b57-ddedd57adc78 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:39.794648 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bed229-0268-45bf-957e-901687d7a63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:39.795655 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bed229-0268-45bf-957e-901687d7a63d None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:39.796145 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bed229-0268-45bf-957e-901687d7a63d None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:39.796837 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bed229-0268-45bf-957e-901687d7a63d None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:39.798262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bed229-0268-45bf-957e-901687d7a63d None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:39.800784 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bed229-0268-45bf-957e-901687d7a63d None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:39.803018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 104/203] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:39 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:39.813752 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bed229-0268-45bf-957e-901687d7a63d None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:39.960594 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf74377-9e9a-452d-9e6d-2510cdaabfae None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:39.992910 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:40.010308 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c3486-0de5-4dcc-b255-3d49301959d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:40.011613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c3486-0de5-4dcc-b255-3d49301959d2 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:40.011899 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c3486-0de5-4dcc-b255-3d49301959d2 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:40.012127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bed229-0268-45bf-957e-901687d7a63d None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:40.012224 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c3486-0de5-4dcc-b255-3d49301959d2 None admin] PATH_INFO: `/v3/users/664bd13e952b45c0bc6d0a00900ede34` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:40.013418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c3486-0de5-4dcc-b255-3d49301959d2 None admin] RBAC: Authorizing `identity:get_user(user_id=664bd13e952b45c0bc6d0a00900ede34)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:40.015136 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c3486-0de5-4dcc-b255-3d49301959d2 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:40.017110 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 100/204] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:39 2022] GET /identity/v3/users/664bd13e952b45c0bc6d0a00900ede34 => generated 289 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:40.025759 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c3486-0de5-4dcc-b255-3d49301959d2 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:40.057525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5d847-1025-4b2f-ae2b-fa9dceaf9731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:40.058566 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5d847-1025-4b2f-ae2b-fa9dceaf9731 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:40.059026 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5d847-1025-4b2f-ae2b-fa9dceaf9731 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:40.059504 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5d847-1025-4b2f-ae2b-fa9dceaf9731 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:40.060611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5d847-1025-4b2f-ae2b-fa9dceaf9731 None admin] RBAC: Adding query filter params (role.id=905829118b764aa9920810cb3b86e0ce, scope.project.id=aa98305d5a0d465b98d3f7ad7d883522, user.id=9b1245c12202439fb26d6b5d4d9105d9) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:40.061156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5d847-1025-4b2f-ae2b-fa9dceaf9731 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:40.063020 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5d847-1025-4b2f-ae2b-fa9dceaf9731 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:40.069611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 105/205] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:39 2022] GET /identity/v3/role_assignments?user.id=9b1245c12202439fb26d6b5d4d9105d9&scope.project.id=aa98305d5a0d465b98d3f7ad7d883522&role.id=905829118b764aa9920810cb3b86e0ce => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:40.091088 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:40.196978 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c3486-0de5-4dcc-b255-3d49301959d2 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:40.239599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001346f8-68f0-44f5-b495-172bca3cba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:40.240216 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001346f8-68f0-44f5-b495-172bca3cba6b None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:40.240523 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001346f8-68f0-44f5-b495-172bca3cba6b None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:40.240794 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001346f8-68f0-44f5-b495-172bca3cba6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:40.351711 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001346f8-68f0-44f5-b495-172bca3cba6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:40.353114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001346f8-68f0-44f5-b495-172bca3cba6b None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:40.412037 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:40.486674 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 101/206] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 20:32:40.492772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5d847-1025-4b2f-ae2b-fa9dceaf9731 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:40.630294 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5d847-1025-4b2f-ae2b-fa9dceaf9731 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:40.669954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a7491-a0f8-412a-910b-3152edde31d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:40.670600 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a7491-a0f8-412a-910b-3152edde31d0 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:40.670881 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a7491-a0f8-412a-910b-3152edde31d0 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:40.671155 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a7491-a0f8-412a-910b-3152edde31d0 None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:40.672291 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a7491-a0f8-412a-910b-3152edde31d0 None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:40.673748 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a7491-a0f8-412a-910b-3152edde31d0 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:40.675368 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 106/207] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:40 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:40.681330 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001346f8-68f0-44f5-b495-172bca3cba6b None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:40.829253 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001346f8-68f0-44f5-b495-172bca3cba6b None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:40.878118 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bf71a-d894-4612-b46f-bf309175de9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:40.878737 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bf71a-d894-4612-b46f-bf309175de9e None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:40.879017 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bf71a-d894-4612-b46f-bf309175de9e None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:40.879291 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bf71a-d894-4612-b46f-bf309175de9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:40.880018 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bf71a-d894-4612-b46f-bf309175de9e None admin] RBAC: Adding query filter params (role.id=11b3648aadfb4d19b376c5acc9465a44, scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa, user.id=664bd13e952b45c0bc6d0a00900ede34) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:40.880408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bf71a-d894-4612-b46f-bf309175de9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:40.881819 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bf71a-d894-4612-b46f-bf309175de9e None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:40.893055 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 102/208] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:40 2022] GET /identity/v3/role_assignments?user.id=664bd13e952b45c0bc6d0a00900ede34&scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa&role.id=11b3648aadfb4d19b376c5acc9465a44 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:41.471704 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df71c4b-0d15-457f-9f58-176f66b1bd5f None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:41.472041 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df71c4b-0d15-457f-9f58-176f66b1bd5f None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:41.472217 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df71c4b-0d15-457f-9f58-176f66b1bd5f None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:41.475589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 107/209] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:41.478966 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fa0d1-2fef-4278-b424-1ba803bfae76 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:41.479407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fa0d1-2fef-4278-b424-1ba803bfae76 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:41.480121 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fa0d1-2fef-4278-b424-1ba803bfae76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:41.491098 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:41.507995 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-f39fa0d1-2fef-4278-b424-1ba803bfae76 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:41.509217 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-f39fa0d1-2fef-4278-b424-1ba803bfae76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:41.600962 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 103/210] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:41.627630 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4968f54-ea1a-4a73-ac44-8a179bbed978 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:41.628569 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4968f54-ea1a-4a73-ac44-8a179bbed978 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:41.629041 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4968f54-ea1a-4a73-ac44-8a179bbed978 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:41.630584 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 108/211] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:41.636785 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01a35c-de10-4c6d-8400-614fd30ed01b None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:41.637078 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01a35c-de10-4c6d-8400-614fd30ed01b None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:41.637360 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01a35c-de10-4c6d-8400-614fd30ed01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:41.659723 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-8f01a35c-de10-4c6d-8400-614fd30ed01b None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:41.661273 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-8f01a35c-de10-4c6d-8400-614fd30ed01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:41.735873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 104/212] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:41.941869 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4968f54-ea1a-4a73-ac44-8a179bbed978 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:41.965403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:42.057123 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4968f54-ea1a-4a73-ac44-8a179bbed978 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:42.067773 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01a35c-de10-4c6d-8400-614fd30ed01b None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:42.097934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79e405-0f37-4df0-bbee-532f535ca697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:42.098870 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79e405-0f37-4df0-bbee-532f535ca697 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:42.099155 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79e405-0f37-4df0-bbee-532f535ca697 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:42.099434 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e79e405-0f37-4df0-bbee-532f535ca697 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:42.115748 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e79e405-0f37-4df0-bbee-532f535ca697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:42.123768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-1e79e405-0f37-4df0-bbee-532f535ca697 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:42.123768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:42.123768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:42.123768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:42.123768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:42.123768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:42.123768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:42.123768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:42.123768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:42.123768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:42.123768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:42.123768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:42.123768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:42.123768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:42.123768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:42.123768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:42.124773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:42.124773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:42.124773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:42.124773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:42.124773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:42.124773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:42.124773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:42.124773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:42.124773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:42.124773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:42.124773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:42.124773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:42.124773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:42.124773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:42.124773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:42.124773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:42.126182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:42.126182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:42.126182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:42.126182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:42.126182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:42.126182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:42.126182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:42.126182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:42.126182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:42.126182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:42.126182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:42.126182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:42.126182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 109/213] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:42.133708 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79e405-0f37-4df0-bbee-532f535ca697 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:42.158099 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:42.197860 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01a35c-de10-4c6d-8400-614fd30ed01b None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:42.241980 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65048d73-9d12-455e-bb8e-f59cb563a239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:42.242931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65048d73-9d12-455e-bb8e-f59cb563a239 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:42.243225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65048d73-9d12-455e-bb8e-f59cb563a239 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:42.243793 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65048d73-9d12-455e-bb8e-f59cb563a239 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:42.244951 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65048d73-9d12-455e-bb8e-f59cb563a239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:42.245488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:42.246447 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65048d73-9d12-455e-bb8e-f59cb563a239 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:42.248805 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 105/214] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:42.257917 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65048d73-9d12-455e-bb8e-f59cb563a239 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:42.271768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e79e405-0f37-4df0-bbee-532f535ca697 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:42.324946 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ba6d2-8cb7-4975-ae2e-b1d3c5c3b3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:42.326152 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ba6d2-8cb7-4975-ae2e-b1d3c5c3b3ae None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:42.327016 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ba6d2-8cb7-4975-ae2e-b1d3c5c3b3ae None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:42.327464 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ba6d2-8cb7-4975-ae2e-b1d3c5c3b3ae None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:42.328872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ba6d2-8cb7-4975-ae2e-b1d3c5c3b3ae None admin] RBAC: Adding query filter params (name=member) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:42.330122 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ba6d2-8cb7-4975-ae2e-b1d3c5c3b3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:42.332761 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ba6d2-8cb7-4975-ae2e-b1d3c5c3b3ae None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:42.345274 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 110/215] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:42.351233 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ba6d2-8cb7-4975-ae2e-b1d3c5c3b3ae None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:42.381113 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65048d73-9d12-455e-bb8e-f59cb563a239 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:42.420520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:42.427747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ff56b-d20d-4b27-a491-c080bb2a3cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:42.428511 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ff56b-d20d-4b27-a491-c080bb2a3cc9 None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:42.429281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ff56b-d20d-4b27-a491-c080bb2a3cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:42.429781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ff56b-d20d-4b27-a491-c080bb2a3cc9 None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:42.430708 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ff56b-d20d-4b27-a491-c080bb2a3cc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:42.432747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ff56b-d20d-4b27-a491-c080bb2a3cc9 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:42.461312 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 106/216] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Sep 24 20:32:42 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:32:42.499529 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ba6d2-8cb7-4975-ae2e-b1d3c5c3b3ae None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:42.539116 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b097d39-8bc7-47e3-8176-fcc848116a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:42.540022 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b097d39-8bc7-47e3-8176-fcc848116a10 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:42.540476 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b097d39-8bc7-47e3-8176-fcc848116a10 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:42.540980 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b097d39-8bc7-47e3-8176-fcc848116a10 None admin] PATH_INFO: `/v3/users/978c6c686fd44bf0ae6148722940cf59` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:42.555766 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:42.559262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b097d39-8bc7-47e3-8176-fcc848116a10 None admin] RBAC: Authorizing `identity:get_user(user_id=978c6c686fd44bf0ae6148722940cf59)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:42.561052 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b097d39-8bc7-47e3-8176-fcc848116a10 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:42.563445 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 111/217] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:42 2022] GET /identity/v3/users/978c6c686fd44bf0ae6148722940cf59 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:42.570440 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ff56b-d20d-4b27-a491-c080bb2a3cc9 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:42.573612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bb392-5311-445b-9a0f-beb4434edb9c None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:42.573919 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bb392-5311-445b-9a0f-beb4434edb9c None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:42.574167 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bb392-5311-445b-9a0f-beb4434edb9c None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:42.576448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 112/218] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:32:42.581574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9501a-bd25-458b-9832-5154117d9fde None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:42.581853 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9501a-bd25-458b-9832-5154117d9fde None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:42.584384 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9501a-bd25-458b-9832-5154117d9fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:42.606490 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-8ae9501a-bd25-458b-9832-5154117d9fde None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:42.607924 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-8ae9501a-bd25-458b-9832-5154117d9fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:42.692113 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 113/219] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 24 20:32:42.724544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ff56b-d20d-4b27-a491-c080bb2a3cc9 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:42.759241 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500c5cb-beb7-4aa9-9ee4-542571afb5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:42.760231 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500c5cb-beb7-4aa9-9ee4-542571afb5ab None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:42.761282 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500c5cb-beb7-4aa9-9ee4-542571afb5ab None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:42.761779 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500c5cb-beb7-4aa9-9ee4-542571afb5ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:42.819519 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:42.834067 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500c5cb-beb7-4aa9-9ee4-542571afb5ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:42.835596 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500c5cb-beb7-4aa9-9ee4-542571afb5ab None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:42.939665 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 107/220] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:32:42.945497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9501a-bd25-458b-9832-5154117d9fde None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:43.030740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500c5cb-beb7-4aa9-9ee4-542571afb5ab None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:43.077365 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9501a-bd25-458b-9832-5154117d9fde None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:43.111832 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:43.118551 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cdf24-42ea-41c4-91a1-46523712e8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:43.119462 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cdf24-42ea-41c4-91a1-46523712e8ca None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:43.119884 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cdf24-42ea-41c4-91a1-46523712e8ca None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:43.120322 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cdf24-42ea-41c4-91a1-46523712e8ca None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:43.121729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cdf24-42ea-41c4-91a1-46523712e8ca None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:43.123467 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cdf24-42ea-41c4-91a1-46523712e8ca None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:43.125689 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 114/221] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:42 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:43.127157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ff027-3a2f-4ef8-9e3f-368c4e37203d None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:43.127588 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ff027-3a2f-4ef8-9e3f-368c4e37203d None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:43.128025 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ff027-3a2f-4ef8-9e3f-368c4e37203d None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:43.129501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 115/222] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:43.134422 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ff027-3a2f-4ef8-9e3f-368c4e37203d None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:43.140782 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:43.153378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500c5cb-beb7-4aa9-9ee4-542571afb5ab None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:43.195703 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecb999-c832-4399-84f7-685ee85e28a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:43.196539 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb999-c832-4399-84f7-685ee85e28a9 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:43.196916 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb999-c832-4399-84f7-685ee85e28a9 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:43.197289 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb999-c832-4399-84f7-685ee85e28a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:43.208620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecb999-c832-4399-84f7-685ee85e28a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:43.213921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-62ecb999-c832-4399-84f7-685ee85e28a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:43.213921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:43.213921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:43.213921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:43.213921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:43.213921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:43.213921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:43.213921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:43.213921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:43.213921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:43.213921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:43.213921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:43.213921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:43.213921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:43.213921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:43.213921 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:43.214976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:43.214976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:43.214976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:43.214976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:43.214976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:43.214976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:43.214976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:43.214976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:43.214976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:43.214976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:43.214976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:43.214976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:43.214976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:43.214976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:43.214976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:43.214976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:43.216144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:43.216144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:43.216144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:43.216144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:43.216144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:43.216144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:43.216144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:43.216144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:43.216144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:43.216144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:43.216144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:43.216144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:43.222535 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 108/223] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:32:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:43.224008 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd1d76-453e-4e4e-bee7-bd1a821a2a0b None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:43.224465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd1d76-453e-4e4e-bee7-bd1a821a2a0b None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:43.224838 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd1d76-453e-4e4e-bee7-bd1a821a2a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:43.244119 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-3abd1d76-453e-4e4e-bee7-bd1a821a2a0b None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:43.246129 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-3abd1d76-453e-4e4e-bee7-bd1a821a2a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:43.259271 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ff027-3a2f-4ef8-9e3f-368c4e37203d None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:43.298594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdcb31-8c16-4051-9d0d-eb6a00e38f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:43.299483 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdcb31-8c16-4051-9d0d-eb6a00e38f80 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:43.299930 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdcb31-8c16-4051-9d0d-eb6a00e38f80 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:43.300363 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdcb31-8c16-4051-9d0d-eb6a00e38f80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:43.301286 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdcb31-8c16-4051-9d0d-eb6a00e38f80 None admin] RBAC: Adding query filter params (role.id=3481273c76dc4a20b3f73c4f8ea558e6, scope.project.id=aa98305d5a0d465b98d3f7ad7d883522, user.id=978c6c686fd44bf0ae6148722940cf59) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:43.301835 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdcb31-8c16-4051-9d0d-eb6a00e38f80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:43.303528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdcb31-8c16-4051-9d0d-eb6a00e38f80 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:43.311020 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 116/224] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:43 2022] GET /identity/v3/role_assignments?user.id=978c6c686fd44bf0ae6148722940cf59&scope.project.id=aa98305d5a0d465b98d3f7ad7d883522&role.id=3481273c76dc4a20b3f73c4f8ea558e6 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:43.312235 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdcb31-8c16-4051-9d0d-eb6a00e38f80 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:43.317195 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 109/225] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:43.381938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:43.426755 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdcb31-8c16-4051-9d0d-eb6a00e38f80 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:43.472184 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599df9af-89aa-4a8e-adb4-b531845000f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:43.472850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599df9af-89aa-4a8e-adb4-b531845000f1 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:43.473131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599df9af-89aa-4a8e-adb4-b531845000f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:43.473475 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599df9af-89aa-4a8e-adb4-b531845000f1 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:43.474212 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599df9af-89aa-4a8e-adb4-b531845000f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:43.474562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599df9af-89aa-4a8e-adb4-b531845000f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:43.475977 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599df9af-89aa-4a8e-adb4-b531845000f1 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:43.485410 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 117/226] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:43.493088 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd1d76-453e-4e4e-bee7-bd1a821a2a0b None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:43.616479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:43.640608 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd1d76-453e-4e4e-bee7-bd1a821a2a0b None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:43.669509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599df9af-89aa-4a8e-adb4-b531845000f1 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:43.681536 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa302f-0676-4b3d-8637-4dfc02bb35a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:43.682497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa302f-0676-4b3d-8637-4dfc02bb35a6 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:43.682983 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa302f-0676-4b3d-8637-4dfc02bb35a6 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:43.683459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa302f-0676-4b3d-8637-4dfc02bb35a6 None admin] PATH_INFO: `/v3/users/9b1245c12202439fb26d6b5d4d9105d9` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:43.686534 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa302f-0676-4b3d-8637-4dfc02bb35a6 None admin] RBAC: Authorizing `identity:get_user(user_id=9b1245c12202439fb26d6b5d4d9105d9)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:43.688173 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa302f-0676-4b3d-8637-4dfc02bb35a6 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:43.691564 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 110/227] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:43 2022] GET /identity/v3/users/9b1245c12202439fb26d6b5d4d9105d9 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:43.700360 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa302f-0676-4b3d-8637-4dfc02bb35a6 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:43.806271 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599df9af-89aa-4a8e-adb4-b531845000f1 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:43.868700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:43.874917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a6f82-728f-4a89-9d62-4e7b831de485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:43.875553 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a6f82-728f-4a89-9d62-4e7b831de485 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:43.875830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a6f82-728f-4a89-9d62-4e7b831de485 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:43.876104 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a6f82-728f-4a89-9d62-4e7b831de485 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:43.900425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a6f82-728f-4a89-9d62-4e7b831de485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:43.905269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa302f-0676-4b3d-8637-4dfc02bb35a6 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:43.906563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-314a6f82-728f-4a89-9d62-4e7b831de485 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:32:43.906563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:43.906563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:43.906563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:43.906563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:43.906563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:43.906563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:43.906563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:43.906563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:43.906563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:43.906563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:43.906563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:43.906563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:43.906563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:43.906563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:43.906563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:43.907608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:43.907608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:43.907608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:43.907608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:43.907608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:43.907608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:43.907608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:43.907608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:43.907608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:43.907608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:43.907608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:43.907608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:43.907608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:43.907608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:43.907608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:43.907608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:43.908596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:43.908596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:43.908596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:43.908596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:43.908596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:43.908596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:43.908596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:43.908596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:43.908596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:43.908596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:43.908596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:32:43.908596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:43.913969 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 118/228] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:32:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:43.920863 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a6f82-728f-4a89-9d62-4e7b831de485 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:43.942116 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6b197-f481-4770-9536-9e02dcac4614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:43.942740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6b197-f481-4770-9536-9e02dcac4614 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:43.943012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6b197-f481-4770-9536-9e02dcac4614 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:43.943276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6b197-f481-4770-9536-9e02dcac4614 None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:43.944402 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6b197-f481-4770-9536-9e02dcac4614 None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:43.945829 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6b197-f481-4770-9536-9e02dcac4614 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:43.952589 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 111/229] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:43 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:43.954065 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6b197-f481-4770-9536-9e02dcac4614 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:43.970083 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:44.088979 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6b197-f481-4770-9536-9e02dcac4614 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:44.107746 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a6f82-728f-4a89-9d62-4e7b831de485 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:44.153053 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3891661-07ab-46fd-abb5-2b8514ea740c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:44.153638 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3891661-07ab-46fd-abb5-2b8514ea740c None admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:44.153918 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3891661-07ab-46fd-abb5-2b8514ea740c None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:44.154190 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3891661-07ab-46fd-abb5-2b8514ea740c None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522/users/9b1245c12202439fb26d6b5d4d9105d9/roles/9cc90aa0ccde4b75b7642101cbf45cf2` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:44.160538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3891661-07ab-46fd-abb5-2b8514ea740c None admin] RBAC: Authorizing `identity:create_grant(project_id=aa98305d5a0d465b98d3f7ad7d883522, user_id=9b1245c12202439fb26d6b5d4d9105d9, role_id=9cc90aa0ccde4b75b7642101cbf45cf2)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:44.165848 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3891661-07ab-46fd-abb5-2b8514ea740c None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:44.176747 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb2b3a-10e8-44a0-836f-3dd176459322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:44.177455 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb2b3a-10e8-44a0-836f-3dd176459322 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:44.177787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb2b3a-10e8-44a0-836f-3dd176459322 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:44.178064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb2b3a-10e8-44a0-836f-3dd176459322 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:44.178978 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb2b3a-10e8-44a0-836f-3dd176459322 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:44.179829 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb2b3a-10e8-44a0-836f-3dd176459322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:44.181252 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb2b3a-10e8-44a0-836f-3dd176459322 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:44.189819 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 112/230] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Sep 24 20:32:43 2022] PUT /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522/users/9b1245c12202439fb26d6b5d4d9105d9/roles/9cc90aa0ccde4b75b7642101cbf45cf2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:32:44.202611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 119/231] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:32:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:44.208057 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3891661-07ab-46fd-abb5-2b8514ea740c None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:44.311493 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:44.351346 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3891661-07ab-46fd-abb5-2b8514ea740c None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:44.403755 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfca8ba-1538-4488-a2b0-97117c3d48cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:44.404352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfca8ba-1538-4488-a2b0-97117c3d48cf None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:44.404650 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfca8ba-1538-4488-a2b0-97117c3d48cf None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:44.404926 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfca8ba-1538-4488-a2b0-97117c3d48cf None admin] PATH_INFO: `/v3/users/9b1245c12202439fb26d6b5d4d9105d9` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:44.406128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfca8ba-1538-4488-a2b0-97117c3d48cf None admin] RBAC: Authorizing `identity:get_user(user_id=9b1245c12202439fb26d6b5d4d9105d9)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:44.407771 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfca8ba-1538-4488-a2b0-97117c3d48cf None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:44.409879 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 113/232] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:44 2022] GET /identity/v3/users/9b1245c12202439fb26d6b5d4d9105d9 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:44.415409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb2b3a-10e8-44a0-836f-3dd176459322 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:44.486954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:44.543721 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb2b3a-10e8-44a0-836f-3dd176459322 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:44.579205 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015c952-faf7-4a81-99f6-c84323351d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:44.579838 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015c952-faf7-4a81-99f6-c84323351d76 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:44.580116 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015c952-faf7-4a81-99f6-c84323351d76 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:44.580426 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015c952-faf7-4a81-99f6-c84323351d76 None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:44.581545 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015c952-faf7-4a81-99f6-c84323351d76 None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:44.583064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015c952-faf7-4a81-99f6-c84323351d76 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:44.585007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 120/233] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:44 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:44.590851 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfca8ba-1538-4488-a2b0-97117c3d48cf None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:44.741983 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfca8ba-1538-4488-a2b0-97117c3d48cf None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:44.788833 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5c9dd-1533-4ee9-885d-018c780d9031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:44.789541 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5c9dd-1533-4ee9-885d-018c780d9031 None admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:44.789825 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5c9dd-1533-4ee9-885d-018c780d9031 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:44.790100 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5c9dd-1533-4ee9-885d-018c780d9031 None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522/users/9b1245c12202439fb26d6b5d4d9105d9/roles/905829118b764aa9920810cb3b86e0ce` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:44.792571 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5c9dd-1533-4ee9-885d-018c780d9031 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa98305d5a0d465b98d3f7ad7d883522, user_id=9b1245c12202439fb26d6b5d4d9105d9, role_id=905829118b764aa9920810cb3b86e0ce)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:44.794000 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5c9dd-1533-4ee9-885d-018c780d9031 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:44.814820 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 114/234] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Sep 24 20:32:44 2022] PUT /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522/users/9b1245c12202439fb26d6b5d4d9105d9/roles/905829118b764aa9920810cb3b86e0ce => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:32:45.698391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb471bd3-9743-4cd8-b945-170251568fb9 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:45.698911 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb471bd3-9743-4cd8-b945-170251568fb9 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:45.699019 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb471bd3-9743-4cd8-b945-170251568fb9 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:45.700409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 121/235] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:45.718425 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bba593-f09f-4072-9404-5fd030618659 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:45.718724 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bba593-f09f-4072-9404-5fd030618659 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:45.719004 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bba593-f09f-4072-9404-5fd030618659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:45.723063 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b86f9d-8c99-4c5b-aec7-2813238359b8 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:45.723340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b86f9d-8c99-4c5b-aec7-2813238359b8 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:45.723616 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b86f9d-8c99-4c5b-aec7-2813238359b8 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:45.725402 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 122/236] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:45.732818 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3abe7-e5d8-4ff7-82f6-1d578b9fea01 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:45.733142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3abe7-e5d8-4ff7-82f6-1d578b9fea01 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:45.733364 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3abe7-e5d8-4ff7-82f6-1d578b9fea01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:45.736826 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:45.755662 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-b1bba593-f09f-4072-9404-5fd030618659 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:45.758963 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-b1bba593-f09f-4072-9404-5fd030618659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:45.772125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-0cf3abe7-e5d8-4ff7-82f6-1d578b9fea01 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:45.773380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-0cf3abe7-e5d8-4ff7-82f6-1d578b9fea01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:45.887166 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 115/237] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:45.901904 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 123/238] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:46.254353 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bba593-f09f-4072-9404-5fd030618659 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:46.343487 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3abe7-e5d8-4ff7-82f6-1d578b9fea01 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:46.390461 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bba593-f09f-4072-9404-5fd030618659 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:46.392222 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:46.438173 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:46.442823 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282147e6-db7f-4b01-a658-0473997d4bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:46.443699 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282147e6-db7f-4b01-a658-0473997d4bc7 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:46.444234 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282147e6-db7f-4b01-a658-0473997d4bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:46.444840 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282147e6-db7f-4b01-a658-0473997d4bc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:46.447070 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282147e6-db7f-4b01-a658-0473997d4bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:46.449166 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3abe7-e5d8-4ff7-82f6-1d578b9fea01 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:46.449509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282147e6-db7f-4b01-a658-0473997d4bc7 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:46.451606 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 116/239] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:46.453577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec720cd-e4da-4d00-a1d7-055a6702ba4c None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:46.453866 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec720cd-e4da-4d00-a1d7-055a6702ba4c None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:46.454141 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec720cd-e4da-4d00-a1d7-055a6702ba4c None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:46.455364 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 117/240] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:46.458478 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec720cd-e4da-4d00-a1d7-055a6702ba4c None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:46.486275 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef48acf-20fc-42cc-b1fc-506a17a9aefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:46.487185 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef48acf-20fc-42cc-b1fc-506a17a9aefc None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:46.487606 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef48acf-20fc-42cc-b1fc-506a17a9aefc None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:46.488004 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef48acf-20fc-42cc-b1fc-506a17a9aefc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:46.500814 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef48acf-20fc-42cc-b1fc-506a17a9aefc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:46.505880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-9ef48acf-20fc-42cc-b1fc-506a17a9aefc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:32:46.505880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:46.505880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:46.505880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:46.505880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:46.505880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:46.505880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:46.505880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:46.505880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:46.505880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:46.505880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:46.505880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:46.505880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:46.505880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:46.505880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:46.505880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:46.506757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:46.506757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:46.506757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:46.506757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:46.506757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:46.506757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:46.506757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:46.506757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:46.506757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:46.506757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:46.506757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:46.506757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:46.506757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:46.506757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:46.506757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:46.506757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:46.507538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:46.507538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:46.507538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:46.507538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:46.507538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:46.507538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:46.507538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:46.507538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:46.507538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:46.507538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:46.507538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:32:46.507538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:46.514770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 124/241] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:32:46.516744 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704c7c8-fba3-4667-a770-393d3bf44a15 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:46.517224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704c7c8-fba3-4667-a770-393d3bf44a15 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:46.517668 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704c7c8-fba3-4667-a770-393d3bf44a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:46.536000 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-4704c7c8-fba3-4667-a770-393d3bf44a15 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:46.537477 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-4704c7c8-fba3-4667-a770-393d3bf44a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:46.575780 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec720cd-e4da-4d00-a1d7-055a6702ba4c None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:46.607335 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 125/242] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:46.608547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704c7c8-fba3-4667-a770-393d3bf44a15 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:46.624370 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d9185-d6af-482a-8575-ffcf4dde4865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:46.625188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d9185-d6af-482a-8575-ffcf4dde4865 None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:46.625637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d9185-d6af-482a-8575-ffcf4dde4865 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:46.626093 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d9185-d6af-482a-8575-ffcf4dde4865 None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:46.626984 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d9185-d6af-482a-8575-ffcf4dde4865 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:46.632910 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d9185-d6af-482a-8575-ffcf4dde4865 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:46.644595 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:46.677698 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 118/243] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Sep 24 20:32:46 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:32:46.718229 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704c7c8-fba3-4667-a770-393d3bf44a15 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:46.758934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe6799-81b4-4d78-9426-da26f4de935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:46.759658 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe6799-81b4-4d78-9426-da26f4de935e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:46.759937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe6799-81b4-4d78-9426-da26f4de935e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:46.760205 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe6799-81b4-4d78-9426-da26f4de935e None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:46.761438 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe6799-81b4-4d78-9426-da26f4de935e None admin] RBAC: Adding query filter params (name=reader) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:46.761972 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe6799-81b4-4d78-9426-da26f4de935e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:46.763393 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe6799-81b4-4d78-9426-da26f4de935e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:46.775889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 126/244] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:46.779451 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d9185-d6af-482a-8575-ffcf4dde4865 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:46.856890 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:46.921516 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d9185-d6af-482a-8575-ffcf4dde4865 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:46.974144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bf541-c761-4159-8767-e54c492c6f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:46.974712 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bf541-c761-4159-8767-e54c492c6f90 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:46.974991 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bf541-c761-4159-8767-e54c492c6f90 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:46.975265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bf541-c761-4159-8767-e54c492c6f90 None admin] PATH_INFO: `/v3/users/9b6d9cb3119b482893e6ac271adbaa6f` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:46.994415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bf541-c761-4159-8767-e54c492c6f90 None admin] RBAC: Authorizing `identity:get_user(user_id=9b6d9cb3119b482893e6ac271adbaa6f)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:46.996438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bf541-c761-4159-8767-e54c492c6f90 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:46.998455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 119/245] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:46 2022] GET /identity/v3/users/9b6d9cb3119b482893e6ac271adbaa6f => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:47.003975 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe6799-81b4-4d78-9426-da26f4de935e None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:47.102329 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:47.108940 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe6799-81b4-4d78-9426-da26f4de935e None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:47.144790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d09a58-f9a4-4410-ad1b-be79303ca6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:47.145397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d09a58-f9a4-4410-ad1b-be79303ca6cc None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:47.145673 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d09a58-f9a4-4410-ad1b-be79303ca6cc None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:47.145945 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d09a58-f9a4-4410-ad1b-be79303ca6cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:47.187600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e668952-b4fb-4b1c-b6ac-00c973496724 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:47.187909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e668952-b4fb-4b1c-b6ac-00c973496724 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:47.188148 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e668952-b4fb-4b1c-b6ac-00c973496724 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:47.189781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 120/246] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:47.197284 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc6090-b188-4eb5-a086-28bc9b54890c None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:47.197569 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc6090-b188-4eb5-a086-28bc9b54890c None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:47.197848 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc6090-b188-4eb5-a086-28bc9b54890c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:47.225454 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-4bdc6090-b188-4eb5-a086-28bc9b54890c None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:47.226673 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-4bdc6090-b188-4eb5-a086-28bc9b54890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:47.231727 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d09a58-f9a4-4410-ad1b-be79303ca6cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:47.233233 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d09a58-f9a4-4410-ad1b-be79303ca6cc None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:47.313071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 121/247] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:32:47.314211 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc6090-b188-4eb5-a086-28bc9b54890c None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:47.365825 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:47.385099 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:47.397929 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 127/248] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:32:47.403857 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d09a58-f9a4-4410-ad1b-be79303ca6cc None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:47.439904 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc6090-b188-4eb5-a086-28bc9b54890c None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:47.492412 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84968a-2121-4853-92fc-3f571d4faaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:47.493694 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84968a-2121-4853-92fc-3f571d4faaf0 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:47.494085 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84968a-2121-4853-92fc-3f571d4faaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:47.494779 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84968a-2121-4853-92fc-3f571d4faaf0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:47.518205 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84968a-2121-4853-92fc-3f571d4faaf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:47.523434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-2b84968a-2121-4853-92fc-3f571d4faaf0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:47.523434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:47.523434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:47.523434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:47.523434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:47.523434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:47.523434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:47.523434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:47.523434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:47.523434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:47.523434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:47.523434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:47.523434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:47.523434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:47.523434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:47.523434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:47.524362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:47.524362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:47.524362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:47.524362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:47.524362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:47.524362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:47.524362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:47.524362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:47.524362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:47.524362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:47.524362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:47.524362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:47.524362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:47.524362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:47.524362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:47.524362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:47.525255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:47.525255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:47.525255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:47.525255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:47.525255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:47.525255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:47.525255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:47.525255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:47.525255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:47.525255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:47.525255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:47.525255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:47.527871 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 122/249] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:47.539108 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84968a-2121-4853-92fc-3f571d4faaf0 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:47.567219 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d09a58-f9a4-4410-ad1b-be79303ca6cc None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:47.616639 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff7d84-9c71-4ff2-b8e6-6c59c66af390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:47.617327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff7d84-9c71-4ff2-b8e6-6c59c66af390 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:47.617730 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff7d84-9c71-4ff2-b8e6-6c59c66af390 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:47.618028 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff7d84-9c71-4ff2-b8e6-6c59c66af390 None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:47.619304 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff7d84-9c71-4ff2-b8e6-6c59c66af390 None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:47.621021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff7d84-9c71-4ff2-b8e6-6c59c66af390 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:47.623315 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 128/250] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:47 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:47.629657 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff7d84-9c71-4ff2-b8e6-6c59c66af390 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:47.808780 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:47.827374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84968a-2121-4853-92fc-3f571d4faaf0 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:47.829926 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:47.887857 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff7d84-9c71-4ff2-b8e6-6c59c66af390 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:47.902671 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b73e1-1d02-4add-9970-7f52334c8edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:47.903640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b73e1-1d02-4add-9970-7f52334c8edf None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:47.904124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b73e1-1d02-4add-9970-7f52334c8edf None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:47.904621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b73e1-1d02-4add-9970-7f52334c8edf None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:47.905494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b73e1-1d02-4add-9970-7f52334c8edf None admin] RBAC: Adding query filter params (name=member) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:47.906116 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b73e1-1d02-4add-9970-7f52334c8edf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:47.907770 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b73e1-1d02-4add-9970-7f52334c8edf None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:47.929016 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 123/251] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:47.930200 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b73e1-1d02-4add-9970-7f52334c8edf None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:47.972772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec17ed-775c-45b5-96af-6c043ca91b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:47.973743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec17ed-775c-45b5-96af-6c043ca91b13 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:47.974253 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec17ed-775c-45b5-96af-6c043ca91b13 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:47.974730 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec17ed-775c-45b5-96af-6c043ca91b13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:47.975758 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec17ed-775c-45b5-96af-6c043ca91b13 None admin] RBAC: Adding query filter params (role.id=11b3648aadfb4d19b376c5acc9465a44, scope.project.id=aa98305d5a0d465b98d3f7ad7d883522, user.id=9b6d9cb3119b482893e6ac271adbaa6f) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:47.976412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec17ed-775c-45b5-96af-6c043ca91b13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:47.978199 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec17ed-775c-45b5-96af-6c043ca91b13 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:47.986287 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 129/252] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:47 2022] GET /identity/v3/role_assignments?user.id=9b6d9cb3119b482893e6ac271adbaa6f&scope.project.id=aa98305d5a0d465b98d3f7ad7d883522&role.id=11b3648aadfb4d19b376c5acc9465a44 => generated 259 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:47.987237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec17ed-775c-45b5-96af-6c043ca91b13 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:48.178570 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b73e1-1d02-4add-9970-7f52334c8edf None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:48.241857 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215da10c-3f14-4116-9187-a69e49c85af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:48.242821 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215da10c-3f14-4116-9187-a69e49c85af9 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:48.243282 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215da10c-3f14-4116-9187-a69e49c85af9 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:48.243734 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215da10c-3f14-4116-9187-a69e49c85af9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:48.267069 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215da10c-3f14-4116-9187-a69e49c85af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:48.272484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-215da10c-3f14-4116-9187-a69e49c85af9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:48.272484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:48.272484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:48.272484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:48.272484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:48.272484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:48.272484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:48.272484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:48.272484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:48.272484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:48.272484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:48.272484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:48.272484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:48.272484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:48.272484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:48.272484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:48.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:48.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:48.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:48.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:48.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:48.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:48.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:48.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:48.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:48.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:48.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:48.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:48.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:48.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:48.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:48.273365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:48.274171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:48.274171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:48.274171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:48.274171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:48.274171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:48.274171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:48.274171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:48.274171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:48.274171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:48.274171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:48.274171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:32:48.274171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:48.280369 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec17ed-775c-45b5-96af-6c043ca91b13 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:48.282116 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 124/253] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:32:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:48.283439 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405944e5-8daa-468a-a75a-72f86fd54792 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:48.283726 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405944e5-8daa-468a-a75a-72f86fd54792 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:48.284004 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405944e5-8daa-468a-a75a-72f86fd54792 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:48.285332 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 125/254] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:48.286026 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405944e5-8daa-468a-a75a-72f86fd54792 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:48.320730 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:48.326463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad74db-f1b7-4f25-aeec-47edac0e5831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:48.327142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad74db-f1b7-4f25-aeec-47edac0e5831 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:48.327431 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad74db-f1b7-4f25-aeec-47edac0e5831 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:48.327732 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad74db-f1b7-4f25-aeec-47edac0e5831 None admin] PATH_INFO: `/v3/users/978c6c686fd44bf0ae6148722940cf59` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:48.329083 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad74db-f1b7-4f25-aeec-47edac0e5831 None admin] RBAC: Authorizing `identity:get_user(user_id=978c6c686fd44bf0ae6148722940cf59)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:48.330552 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad74db-f1b7-4f25-aeec-47edac0e5831 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:48.332140 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 130/255] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:47 2022] GET /identity/v3/users/978c6c686fd44bf0ae6148722940cf59 => generated 297 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:48.334880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3093e7-ee24-4249-b5fa-1ebff82776d0 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:48.336027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3093e7-ee24-4249-b5fa-1ebff82776d0 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:48.338636 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3093e7-ee24-4249-b5fa-1ebff82776d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:48.375624 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-4c3093e7-ee24-4249-b5fa-1ebff82776d0 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:48.376676 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:48.376878 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-4c3093e7-ee24-4249-b5fa-1ebff82776d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:48.496649 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 131/256] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:48.497259 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3093e7-ee24-4249-b5fa-1ebff82776d0 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:48.523622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405944e5-8daa-468a-a75a-72f86fd54792 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:48.591171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a553596-c1c1-4d11-884a-fef8eb4a76b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:48.591795 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a553596-c1c1-4d11-884a-fef8eb4a76b2 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:48.593709 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a553596-c1c1-4d11-884a-fef8eb4a76b2 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:48.594001 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a553596-c1c1-4d11-884a-fef8eb4a76b2 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:48.594670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a553596-c1c1-4d11-884a-fef8eb4a76b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:48.594982 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a553596-c1c1-4d11-884a-fef8eb4a76b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:48.598049 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a553596-c1c1-4d11-884a-fef8eb4a76b2 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:48.619185 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 126/257] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:48.624953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a553596-c1c1-4d11-884a-fef8eb4a76b2 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:48.670329 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3093e7-ee24-4249-b5fa-1ebff82776d0 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:48.716556 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:48.742535 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907db04-67d5-4db5-9d42-8e2e8d72046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:48.743171 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907db04-67d5-4db5-9d42-8e2e8d72046e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:48.743462 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907db04-67d5-4db5-9d42-8e2e8d72046e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:48.743742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907db04-67d5-4db5-9d42-8e2e8d72046e None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:48.749139 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907db04-67d5-4db5-9d42-8e2e8d72046e None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:48.750484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907db04-67d5-4db5-9d42-8e2e8d72046e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:48.752275 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 132/258] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:48 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:48.757896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907db04-67d5-4db5-9d42-8e2e8d72046e None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:48.766812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:48.774906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a553596-c1c1-4d11-884a-fef8eb4a76b2 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:48.848565 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d5cf0-87ef-4280-a5bf-a5cd88178f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:48.850038 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d5cf0-87ef-4280-a5bf-a5cd88178f71 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:48.850524 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d5cf0-87ef-4280-a5bf-a5cd88178f71 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:48.850996 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d5cf0-87ef-4280-a5bf-a5cd88178f71 None admin] PATH_INFO: `/v3/users/9b1245c12202439fb26d6b5d4d9105d9` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:48.854237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d5cf0-87ef-4280-a5bf-a5cd88178f71 None admin] RBAC: Authorizing `identity:get_user(user_id=9b1245c12202439fb26d6b5d4d9105d9)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:48.855991 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d5cf0-87ef-4280-a5bf-a5cd88178f71 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:48.858313 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 127/259] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:48 2022] GET /identity/v3/users/9b1245c12202439fb26d6b5d4d9105d9 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:48.863924 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d5cf0-87ef-4280-a5bf-a5cd88178f71 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:48.938544 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907db04-67d5-4db5-9d42-8e2e8d72046e None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:49.007525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd1715-90cc-431c-8678-f8b8845e55fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:49.008026 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd1715-90cc-431c-8678-f8b8845e55fd None admin] REQUEST_METHOD: `PUT` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:49.008365 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd1715-90cc-431c-8678-f8b8845e55fd None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:49.008669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd1715-90cc-431c-8678-f8b8845e55fd None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522/users/978c6c686fd44bf0ae6148722940cf59/roles/3481273c76dc4a20b3f73c4f8ea558e6` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:49.011767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd1715-90cc-431c-8678-f8b8845e55fd None admin] RBAC: Authorizing `identity:create_grant(project_id=aa98305d5a0d465b98d3f7ad7d883522, user_id=978c6c686fd44bf0ae6148722940cf59, role_id=3481273c76dc4a20b3f73c4f8ea558e6)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:49.016192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd1715-90cc-431c-8678-f8b8845e55fd None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:49.038279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 133/260] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Sep 24 20:32:48 2022] PUT /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522/users/978c6c686fd44bf0ae6148722940cf59/roles/3481273c76dc4a20b3f73c4f8ea558e6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:32:49.054408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d5cf0-87ef-4280-a5bf-a5cd88178f71 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:49.112602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd1715-90cc-431c-8678-f8b8845e55fd None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:49.122065 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1bf0f-31f4-4efe-b4b9-b298937e3c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:49.123076 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1bf0f-31f4-4efe-b4b9-b298937e3c5a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:49.123587 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1bf0f-31f4-4efe-b4b9-b298937e3c5a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:49.124058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1bf0f-31f4-4efe-b4b9-b298937e3c5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:49.156713 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:49.236566 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1bf0f-31f4-4efe-b4b9-b298937e3c5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:49.238305 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1bf0f-31f4-4efe-b4b9-b298937e3c5a None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:49.262475 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:49.349005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd1715-90cc-431c-8678-f8b8845e55fd None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:49.413301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be53eb-97fd-4fdf-bfe4-db953a4669b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:49.413936 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be53eb-97fd-4fdf-bfe4-db953a4669b8 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:49.414214 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be53eb-97fd-4fdf-bfe4-db953a4669b8 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:49.414487 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be53eb-97fd-4fdf-bfe4-db953a4669b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:49.426253 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be53eb-97fd-4fdf-bfe4-db953a4669b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:49.431860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-c1be53eb-97fd-4fdf-bfe4-db953a4669b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:32:49.431860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:49.431860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:49.431860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:49.431860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:49.431860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:49.431860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:49.431860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:49.431860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:49.431860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:49.431860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:49.431860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:49.431860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:49.431860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:49.431860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:49.431860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:49.433324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:49.433324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:49.433324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:49.433324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:49.433324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:49.433324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:49.433324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:49.433324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:49.433324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:49.433324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:49.433324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:49.433324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:49.433324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:49.433324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:49.433324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:49.433324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:49.434192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:49.434192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:49.434192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:49.434192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:49.434192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:49.434192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:49.434192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:49.434192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:49.434192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:49.434192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:49.434192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:32:49.434192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:49.434192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 134/261] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:32:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:32:49.441276 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be53eb-97fd-4fdf-bfe4-db953a4669b8 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:49.447130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 128/262] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 20:32:49.453246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1bf0f-31f4-4efe-b4b9-b298937e3c5a None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:49.536799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:49.603598 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be53eb-97fd-4fdf-bfe4-db953a4669b8 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:49.614058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1bf0f-31f4-4efe-b4b9-b298937e3c5a None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:49.631299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:49.674044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd236e0-055c-434a-b561-20a1aea9cf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:49.675015 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd236e0-055c-434a-b561-20a1aea9cf5a None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:49.675501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd236e0-055c-434a-b561-20a1aea9cf5a None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:49.675993 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd236e0-055c-434a-b561-20a1aea9cf5a None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:49.676913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd236e0-055c-434a-b561-20a1aea9cf5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:49.677421 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd236e0-055c-434a-b561-20a1aea9cf5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:49.679029 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd236e0-055c-434a-b561-20a1aea9cf5a None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:49.679212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d9660-3e64-4890-bc14-bcd2522ee451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:49.679852 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d9660-3e64-4890-bc14-bcd2522ee451 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:49.680129 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d9660-3e64-4890-bc14-bcd2522ee451 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:49.680424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d9660-3e64-4890-bc14-bcd2522ee451 None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:49.685090 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d9660-3e64-4890-bc14-bcd2522ee451 None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:49.686490 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d9660-3e64-4890-bc14-bcd2522ee451 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:49.688536 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 129/263] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:49 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:49.693926 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d9660-3e64-4890-bc14-bcd2522ee451 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:49.695856 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 135/264] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:32:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:49.701901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd236e0-055c-434a-b561-20a1aea9cf5a None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:49.891991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd236e0-055c-434a-b561-20a1aea9cf5a None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:49.900360 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d9660-3e64-4890-bc14-bcd2522ee451 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:49.936704 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:49.955015 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87950782-c016-4e4d-9594-5cab5d8a5e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:49.955628 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950782-c016-4e4d-9594-5cab5d8a5e65 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:49.955907 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950782-c016-4e4d-9594-5cab5d8a5e65 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:49.956182 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950782-c016-4e4d-9594-5cab5d8a5e65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:49.956950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87950782-c016-4e4d-9594-5cab5d8a5e65 None admin] RBAC: Adding query filter params (role.id=9cc90aa0ccde4b75b7642101cbf45cf2, scope.project.id=aa98305d5a0d465b98d3f7ad7d883522, user.id=9b1245c12202439fb26d6b5d4d9105d9) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:49.957260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87950782-c016-4e4d-9594-5cab5d8a5e65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:49.958703 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87950782-c016-4e4d-9594-5cab5d8a5e65 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:49.962412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9052963-b3a7-4753-89d0-16c69afbab2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:49.963060 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9052963-b3a7-4753-89d0-16c69afbab2e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:49.963344 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9052963-b3a7-4753-89d0-16c69afbab2e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:49.963690 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9052963-b3a7-4753-89d0-16c69afbab2e None admin] PATH_INFO: `/v3/users/9b1245c12202439fb26d6b5d4d9105d9` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:49.969113 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9052963-b3a7-4753-89d0-16c69afbab2e None admin] RBAC: Authorizing `identity:get_user(user_id=9b1245c12202439fb26d6b5d4d9105d9)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:49.970574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9052963-b3a7-4753-89d0-16c69afbab2e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:49.970743 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 130/265] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:49 2022] GET /identity/v3/role_assignments?user.id=9b1245c12202439fb26d6b5d4d9105d9&scope.project.id=aa98305d5a0d465b98d3f7ad7d883522&role.id=9cc90aa0ccde4b75b7642101cbf45cf2 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:49.972447 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 136/266] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:49 2022] GET /identity/v3/users/9b1245c12202439fb26d6b5d4d9105d9 => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:49.982184 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87950782-c016-4e4d-9594-5cab5d8a5e65 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:50.118691 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87950782-c016-4e4d-9594-5cab5d8a5e65 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:50.158363 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c1bb6-ded0-4353-9475-7fbfa11c1d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:50.159002 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c1bb6-ded0-4353-9475-7fbfa11c1d59 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:50.159279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c1bb6-ded0-4353-9475-7fbfa11c1d59 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:50.159553 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c1bb6-ded0-4353-9475-7fbfa11c1d59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:50.225054 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:50.235843 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c1bb6-ded0-4353-9475-7fbfa11c1d59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:50.237348 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c1bb6-ded0-4353-9475-7fbfa11c1d59 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:50.346585 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 131/267] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:32:50.352099 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9052963-b3a7-4753-89d0-16c69afbab2e None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:50.433079 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:50.508934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9052963-b3a7-4753-89d0-16c69afbab2e None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:50.553319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41fca3-ea73-4953-aa68-70f05f3d3c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:50.553957 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41fca3-ea73-4953-aa68-70f05f3d3c6b None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:50.554240 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41fca3-ea73-4953-aa68-70f05f3d3c6b None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:50.554520 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41fca3-ea73-4953-aa68-70f05f3d3c6b None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:50.555642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41fca3-ea73-4953-aa68-70f05f3d3c6b None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:50.557157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41fca3-ea73-4953-aa68-70f05f3d3c6b None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:50.559202 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 137/268] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:50 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:50.565058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c1bb6-ded0-4353-9475-7fbfa11c1d59 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:50.681629 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:50.696493 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c1bb6-ded0-4353-9475-7fbfa11c1d59 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:50.741966 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270055a6-03bb-46c6-b3fb-26c04db1941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:50.742596 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270055a6-03bb-46c6-b3fb-26c04db1941e None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:50.742875 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270055a6-03bb-46c6-b3fb-26c04db1941e None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:50.743148 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270055a6-03bb-46c6-b3fb-26c04db1941e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:50.744008 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270055a6-03bb-46c6-b3fb-26c04db1941e None admin] RBAC: Adding query filter params (role.id=905829118b764aa9920810cb3b86e0ce, scope.project.id=aa98305d5a0d465b98d3f7ad7d883522, user.id=9b1245c12202439fb26d6b5d4d9105d9) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:50.744320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270055a6-03bb-46c6-b3fb-26c04db1941e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:50.746461 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270055a6-03bb-46c6-b3fb-26c04db1941e None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:50.756259 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 132/269] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:50 2022] GET /identity/v3/role_assignments?user.id=9b1245c12202439fb26d6b5d4d9105d9&scope.project.id=aa98305d5a0d465b98d3f7ad7d883522&role.id=905829118b764aa9920810cb3b86e0ce => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:50.792420 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82397428-f85a-49d4-8836-34ead45eaef3 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:50.792730 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82397428-f85a-49d4-8836-34ead45eaef3 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:50.792982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82397428-f85a-49d4-8836-34ead45eaef3 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:50.794513 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 138/270] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:50.800547 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4f883-367a-465c-bbed-7b16953f01ac None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:50.800855 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4f883-367a-465c-bbed-7b16953f01ac None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:50.801109 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4f883-367a-465c-bbed-7b16953f01ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:50.821554 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-97a4f883-367a-465c-bbed-7b16953f01ac None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:50.822981 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-97a4f883-367a-465c-bbed-7b16953f01ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:50.899071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 133/271] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:50.987332 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d64506-d6cc-48ca-b48e-99fd6c5af3a3 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:50.987818 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d64506-d6cc-48ca-b48e-99fd6c5af3a3 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:50.987818 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d64506-d6cc-48ca-b48e-99fd6c5af3a3 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:50.989438 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 139/272] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:50.995190 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1634ff7-b566-4480-9b38-73d5e2a0b579 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:50.995755 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1634ff7-b566-4480-9b38-73d5e2a0b579 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:50.995755 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1634ff7-b566-4480-9b38-73d5e2a0b579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:51.015113 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-a1634ff7-b566-4480-9b38-73d5e2a0b579 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:51.016366 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-a1634ff7-b566-4480-9b38-73d5e2a0b579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:51.089085 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 134/273] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:51.214767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ecc67-2ed5-493f-a887-4e8dccedec85 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:51.215066 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ecc67-2ed5-493f-a887-4e8dccedec85 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:51.215314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ecc67-2ed5-493f-a887-4e8dccedec85 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:51.216962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 140/274] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:51.222171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d139b-3dec-43c7-8e8f-710d324c9fd0 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:51.222464 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d139b-3dec-43c7-8e8f-710d324c9fd0 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:51.222742 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d139b-3dec-43c7-8e8f-710d324c9fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:51.242784 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-a38d139b-3dec-43c7-8e8f-710d324c9fd0 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:51.243962 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-a38d139b-3dec-43c7-8e8f-710d324c9fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:51.251495 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:51.314413 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 135/275] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:51.330553 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ecc67-2ed5-493f-a887-4e8dccedec85 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:51.453036 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ecc67-2ed5-493f-a887-4e8dccedec85 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:51.467963 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:51.478501 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d139b-3dec-43c7-8e8f-710d324c9fd0 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:51.495722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458940ac-f00f-4d78-8581-b3c02c82580d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:51.495893 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458940ac-f00f-4d78-8581-b3c02c82580d None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:51.496183 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458940ac-f00f-4d78-8581-b3c02c82580d None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:51.496501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458940ac-f00f-4d78-8581-b3c02c82580d None admin] PATH_INFO: `/v3/roles/member` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:51.508831 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458940ac-f00f-4d78-8581-b3c02c82580d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:51.513528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-458940ac-f00f-4d78-8581-b3c02c82580d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:51.513528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:51.513528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:51.513528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:51.513528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:51.513528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:51.513528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:51.513528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:51.513528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:51.513528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:51.513528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:51.513528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:51.513528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:51.513528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:51.513528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:51.513528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:51.514435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:51.514435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:51.514435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:51.514435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:51.514435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:51.514435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:51.514435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:51.514435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:51.514435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:51.514435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:51.514435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:51.514435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:51.514435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:51.514435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:51.514435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:51.514435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:51.515237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:51.515237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:51.515237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:51.515237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:51.515237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:51.515237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:51.515237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:51.515237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:51.515237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:51.515237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:51.515237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:51.515237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:51.515237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 141/276] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:51.520163 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458940ac-f00f-4d78-8581-b3c02c82580d None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:51.606121 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d139b-3dec-43c7-8e8f-710d324c9fd0 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:51.635992 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458940ac-f00f-4d78-8581-b3c02c82580d None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:51.643249 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8995407-c4ac-4541-9074-5e491e4f2e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:51.644064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8995407-c4ac-4541-9074-5e491e4f2e40 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:51.644538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8995407-c4ac-4541-9074-5e491e4f2e40 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:51.644963 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8995407-c4ac-4541-9074-5e491e4f2e40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:51.646195 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8995407-c4ac-4541-9074-5e491e4f2e40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:51.647761 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8995407-c4ac-4541-9074-5e491e4f2e40 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:51.650036 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 136/277] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:51.655383 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8995407-c4ac-4541-9074-5e491e4f2e40 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:51.671199 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:51.675651 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49ef79-79dc-4c3b-9a83-2e9cd8f110ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:51.676259 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49ef79-79dc-4c3b-9a83-2e9cd8f110ec None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:51.676566 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49ef79-79dc-4c3b-9a83-2e9cd8f110ec None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:51.676838 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49ef79-79dc-4c3b-9a83-2e9cd8f110ec None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:51.677486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49ef79-79dc-4c3b-9a83-2e9cd8f110ec None admin] RBAC: Adding query filter params (name=member) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:51.677786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49ef79-79dc-4c3b-9a83-2e9cd8f110ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:51.679279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49ef79-79dc-4c3b-9a83-2e9cd8f110ec None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:51.688495 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 142/278] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:51.689370 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49ef79-79dc-4c3b-9a83-2e9cd8f110ec None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:51.724533 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:51.773138 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8995407-c4ac-4541-9074-5e491e4f2e40 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:51.795209 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49ef79-79dc-4c3b-9a83-2e9cd8f110ec None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:51.810441 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd17af0-f01f-4ac3-8b6e-640d61956fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:51.811056 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd17af0-f01f-4ac3-8b6e-640d61956fe7 None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:51.811331 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd17af0-f01f-4ac3-8b6e-640d61956fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:51.811602 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd17af0-f01f-4ac3-8b6e-640d61956fe7 None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:51.812478 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd17af0-f01f-4ac3-8b6e-640d61956fe7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:51.814531 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd17af0-f01f-4ac3-8b6e-640d61956fe7 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:51.837150 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a83f7-9741-4e34-a10e-146d091924e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:51.838080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a83f7-9741-4e34-a10e-146d091924e4 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:51.839055 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a83f7-9741-4e34-a10e-146d091924e4 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:51.839463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a83f7-9741-4e34-a10e-146d091924e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:51.840137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 137/279] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Sep 24 20:32:51 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:32:51.841009 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd17af0-f01f-4ac3-8b6e-640d61956fe7 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:51.860885 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a83f7-9741-4e34-a10e-146d091924e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:51.866156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-079a83f7-9741-4e34-a10e-146d091924e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:32:51.866156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:51.866156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:51.866156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:51.866156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:51.866156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:51.866156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:51.866156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:51.866156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:51.866156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:51.866156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:51.866156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:51.866156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:51.866156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:51.866156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:51.866156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:51.867127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:51.867127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:51.867127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:51.867127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:51.867127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:51.867127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:51.867127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:51.867127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:51.867127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:51.867127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:51.867127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:51.867127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:51.867127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:51.867127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:51.867127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:51.867127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:51.867921 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:51.867921 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:51.867921 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:51.867921 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:51.867921 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:51.867921 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:51.867921 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:51.867921 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:51.867921 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:51.867921 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:51.867921 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:32:51.867921 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:51.872425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 143/280] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:51.873731 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a83f7-9741-4e34-a10e-146d091924e4 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:51.945049 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:51.981252 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:51.989669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a83f7-9741-4e34-a10e-146d091924e4 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:51.997263 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd17af0-f01f-4ac3-8b6e-640d61956fe7 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:52.029315 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a296f-08df-4f89-9bd3-9b10acbc7326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:52.029841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a296f-08df-4f89-9bd3-9b10acbc7326 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:52.030121 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a296f-08df-4f89-9bd3-9b10acbc7326 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:52.030454 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a296f-08df-4f89-9bd3-9b10acbc7326 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:52.031137 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a296f-08df-4f89-9bd3-9b10acbc7326 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:52.031439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a296f-08df-4f89-9bd3-9b10acbc7326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:52.032889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a296f-08df-4f89-9bd3-9b10acbc7326 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:52.046693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f780708-3c12-4f61-8cfa-662d2ee78067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:52.047675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f780708-3c12-4f61-8cfa-662d2ee78067 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:52.047829 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 144/281] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:52.048564 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f780708-3c12-4f61-8cfa-662d2ee78067 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:52.049022 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f780708-3c12-4f61-8cfa-662d2ee78067 None admin] PATH_INFO: `/v3/users/1c2722fa70ef491298cb6d7c71a4d76e` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:52.049252 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a296f-08df-4f89-9bd3-9b10acbc7326 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:52.066062 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f780708-3c12-4f61-8cfa-662d2ee78067 None admin] RBAC: Authorizing `identity:get_user(user_id=1c2722fa70ef491298cb6d7c71a4d76e)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:52.067671 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f780708-3c12-4f61-8cfa-662d2ee78067 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:52.074694 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 138/282] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:51 2022] GET /identity/v3/users/1c2722fa70ef491298cb6d7c71a4d76e => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:52.076092 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f780708-3c12-4f61-8cfa-662d2ee78067 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:52.198788 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a296f-08df-4f89-9bd3-9b10acbc7326 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:52.204405 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f780708-3c12-4f61-8cfa-662d2ee78067 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:52.230925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:52.246600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651372e-eb18-49d9-b1d9-24a1ac5b3659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:52.246792 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f7d34-1c91-47cb-adf8-a11f4bb8fcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:52.247215 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651372e-eb18-49d9-b1d9-24a1ac5b3659 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:52.247316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f7d34-1c91-47cb-adf8-a11f4bb8fcf5 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:52.247493 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651372e-eb18-49d9-b1d9-24a1ac5b3659 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:52.247584 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f7d34-1c91-47cb-adf8-a11f4bb8fcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:52.248588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651372e-eb18-49d9-b1d9-24a1ac5b3659 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:52.248702 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f7d34-1c91-47cb-adf8-a11f4bb8fcf5 None admin] PATH_INFO: `/v3/users/9b6d9cb3119b482893e6ac271adbaa6f` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:52.250035 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f7d34-1c91-47cb-adf8-a11f4bb8fcf5 None admin] RBAC: Authorizing `identity:get_user(user_id=9b6d9cb3119b482893e6ac271adbaa6f)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:52.250135 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651372e-eb18-49d9-b1d9-24a1ac5b3659 None admin] RBAC: Adding query filter params (role.id=3481273c76dc4a20b3f73c4f8ea558e6, user.id=1c2722fa70ef491298cb6d7c71a4d76e, scope.system=all) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:52.250135 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651372e-eb18-49d9-b1d9-24a1ac5b3659 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:52.250377 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f7d34-1c91-47cb-adf8-a11f4bb8fcf5 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:52.250721 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651372e-eb18-49d9-b1d9-24a1ac5b3659 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:52.253239 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 145/283] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:52 2022] GET /identity/v3/users/9b6d9cb3119b482893e6ac271adbaa6f => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:52.253700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4cfc2-eac3-45ab-9de2-21812d1266b7 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:52.254424 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4cfc2-eac3-45ab-9de2-21812d1266b7 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:52.254424 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4cfc2-eac3-45ab-9de2-21812d1266b7 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:52.255659 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 146/284] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:52.256922 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 139/285] 10.222.0.61 () {56 vars in 1308 bytes} [Sat Sep 24 20:32:52 2022] GET /identity/v3/role_assignments?user.id=1c2722fa70ef491298cb6d7c71a4d76e&scope.system=all&role.id=3481273c76dc4a20b3f73c4f8ea558e6 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:52.257407 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4cfc2-eac3-45ab-9de2-21812d1266b7 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:52.262593 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82e75d-65e1-4ea2-a782-80c23461989f None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:52.262875 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82e75d-65e1-4ea2-a782-80c23461989f None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:52.263150 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82e75d-65e1-4ea2-a782-80c23461989f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:52.284449 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-7f82e75d-65e1-4ea2-a782-80c23461989f None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:52.285570 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-7f82e75d-65e1-4ea2-a782-80c23461989f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:52.289293 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:52.373722 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 140/286] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:32:52.404062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4cfc2-eac3-45ab-9de2-21812d1266b7 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:52.444760 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043b8c9-2179-45a6-9783-afdb920c2576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:52.445411 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043b8c9-2179-45a6-9783-afdb920c2576 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:52.445691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043b8c9-2179-45a6-9783-afdb920c2576 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:52.445963 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043b8c9-2179-45a6-9783-afdb920c2576 None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:52.447267 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043b8c9-2179-45a6-9783-afdb920c2576 None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:52.448932 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043b8c9-2179-45a6-9783-afdb920c2576 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:52.451015 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 147/287] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:52 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:52.456538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82e75d-65e1-4ea2-a782-80c23461989f None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:52.591417 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82e75d-65e1-4ea2-a782-80c23461989f None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:52.612733 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:52.627653 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1d045-d959-446d-9c54-dbfd31129994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:52.628302 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1d045-d959-446d-9c54-dbfd31129994 None admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:52.628612 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1d045-d959-446d-9c54-dbfd31129994 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:52.628887 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1d045-d959-446d-9c54-dbfd31129994 None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522/users/9b6d9cb3119b482893e6ac271adbaa6f/roles/11b3648aadfb4d19b376c5acc9465a44` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:52.630846 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1d045-d959-446d-9c54-dbfd31129994 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa98305d5a0d465b98d3f7ad7d883522, user_id=9b6d9cb3119b482893e6ac271adbaa6f, role_id=11b3648aadfb4d19b376c5acc9465a44)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:52.632419 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1d045-d959-446d-9c54-dbfd31129994 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:52.652308 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 141/288] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Sep 24 20:32:52 2022] PUT /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522/users/9b6d9cb3119b482893e6ac271adbaa6f/roles/11b3648aadfb4d19b376c5acc9465a44 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:32:52.715827 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043b8c9-2179-45a6-9783-afdb920c2576 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:52.840104 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:52.851589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043b8c9-2179-45a6-9783-afdb920c2576 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:52.897636 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a4cce-8aae-4920-8c24-415b884162ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:52.898279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a4cce-8aae-4920-8c24-415b884162ca None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:52.898597 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a4cce-8aae-4920-8c24-415b884162ca None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:52.898884 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a4cce-8aae-4920-8c24-415b884162ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:52.910818 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a4cce-8aae-4920-8c24-415b884162ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:52.916457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-ac2a4cce-8aae-4920-8c24-415b884162ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:52.916457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:52.916457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:52.916457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:52.916457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:52.916457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:52.916457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:52.916457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:52.916457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:52.916457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:52.916457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:52.916457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:52.916457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:52.916457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:52.916457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:52.916457 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:52.917642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:52.917642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:52.917642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:52.917642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:52.917642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:52.917642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:52.917642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:52.917642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:52.917642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:52.917642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:52.917642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:52.917642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:52.917642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:52.917642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:52.917642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:52.917642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:52.918443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:52.918443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:52.918443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:52.918443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:52.918443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:52.918443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:52.918443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:52.918443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:52.918443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:52.918443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:52.918443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:52.918443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:52.918443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 148/289] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:52.923903 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1d045-d959-446d-9c54-dbfd31129994 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:53.051296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1d045-d959-446d-9c54-dbfd31129994 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:53.087053 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827da0e-2dd1-4a08-b08a-2fa65b9e13ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:53.087667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827da0e-2dd1-4a08-b08a-2fa65b9e13ab None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:53.087946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827da0e-2dd1-4a08-b08a-2fa65b9e13ab None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:53.088222 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827da0e-2dd1-4a08-b08a-2fa65b9e13ab None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:53.089427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827da0e-2dd1-4a08-b08a-2fa65b9e13ab None admin] RBAC: Adding query filter params (name=member) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:53.089729 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827da0e-2dd1-4a08-b08a-2fa65b9e13ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:53.091194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827da0e-2dd1-4a08-b08a-2fa65b9e13ab None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:53.103461 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 142/290] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:53.109302 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a4cce-8aae-4920-8c24-415b884162ca None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:53.284781 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a4cce-8aae-4920-8c24-415b884162ca None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:53.326327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91472b2d-8b87-43ff-88b1-8cc0d58d6864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:53.327021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91472b2d-8b87-43ff-88b1-8cc0d58d6864 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:53.327310 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91472b2d-8b87-43ff-88b1-8cc0d58d6864 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:53.327588 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91472b2d-8b87-43ff-88b1-8cc0d58d6864 None admin] PATH_INFO: `/v3/users/978c6c686fd44bf0ae6148722940cf59` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:53.328764 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91472b2d-8b87-43ff-88b1-8cc0d58d6864 None admin] RBAC: Authorizing `identity:get_user(user_id=978c6c686fd44bf0ae6148722940cf59)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:53.330213 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91472b2d-8b87-43ff-88b1-8cc0d58d6864 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:53.332088 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 149/291] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:53 2022] GET /identity/v3/users/978c6c686fd44bf0ae6148722940cf59 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:53.337594 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827da0e-2dd1-4a08-b08a-2fa65b9e13ab None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:53.406471 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:53.493681 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827da0e-2dd1-4a08-b08a-2fa65b9e13ab None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:53.541215 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3508784-678d-4aec-89c0-2e95cddbfd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:53.542823 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3508784-678d-4aec-89c0-2e95cddbfd4e None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:53.543573 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3508784-678d-4aec-89c0-2e95cddbfd4e None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:53.544279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3508784-678d-4aec-89c0-2e95cddbfd4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:53.639650 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3508784-678d-4aec-89c0-2e95cddbfd4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:53.641461 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3508784-678d-4aec-89c0-2e95cddbfd4e None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:53.687927 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:53.752655 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 143/292] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:32:53.760360 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91472b2d-8b87-43ff-88b1-8cc0d58d6864 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:53.796499 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:53.912646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91472b2d-8b87-43ff-88b1-8cc0d58d6864 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:53.964451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1955e00-51a7-4fe5-9587-24fc77836127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:53.965011 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1955e00-51a7-4fe5-9587-24fc77836127 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:53.965295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1955e00-51a7-4fe5-9587-24fc77836127 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:53.965572 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1955e00-51a7-4fe5-9587-24fc77836127 None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:53.966716 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1955e00-51a7-4fe5-9587-24fc77836127 None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:53.968149 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1955e00-51a7-4fe5-9587-24fc77836127 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:53.970097 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 150/293] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:53 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:53.975953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3508784-678d-4aec-89c0-2e95cddbfd4e None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:54.236268 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3508784-678d-4aec-89c0-2e95cddbfd4e None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:54.345365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbe4fc-660a-44d1-be0a-910720a9c6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:54.345993 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbe4fc-660a-44d1-be0a-910720a9c6a3 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:54.346272 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbe4fc-660a-44d1-be0a-910720a9c6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:54.346543 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbe4fc-660a-44d1-be0a-910720a9c6a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:54.347279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbe4fc-660a-44d1-be0a-910720a9c6a3 None admin] RBAC: Adding query filter params (role.id=3481273c76dc4a20b3f73c4f8ea558e6, scope.project.id=aa98305d5a0d465b98d3f7ad7d883522, user.id=978c6c686fd44bf0ae6148722940cf59) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:54.347591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbe4fc-660a-44d1-be0a-910720a9c6a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:54.349044 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbe4fc-660a-44d1-be0a-910720a9c6a3 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:54.361189 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 144/294] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:53 2022] GET /identity/v3/role_assignments?user.id=978c6c686fd44bf0ae6148722940cf59&scope.project.id=aa98305d5a0d465b98d3f7ad7d883522&role.id=3481273c76dc4a20b3f73c4f8ea558e6 => generated 608 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:55.107758 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002c49b-89fa-489d-ab18-715497b02557 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:55.108307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002c49b-89fa-489d-ab18-715497b02557 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:55.108405 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002c49b-89fa-489d-ab18-715497b02557 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:55.109743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 151/295] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:55.120968 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd077b5a-e31e-4a45-ab93-3f0f2fbf054a None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:55.121478 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd077b5a-e31e-4a45-ab93-3f0f2fbf054a None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:55.121902 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd077b5a-e31e-4a45-ab93-3f0f2fbf054a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:55.129608 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:55.141089 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-dd077b5a-e31e-4a45-ab93-3f0f2fbf054a None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:55.142301 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-dd077b5a-e31e-4a45-ab93-3f0f2fbf054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:55.212323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0bd57-cf71-44e8-bc32-1bd371c7613a None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:55.212635 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0bd57-cf71-44e8-bc32-1bd371c7613a None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:55.212978 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0bd57-cf71-44e8-bc32-1bd371c7613a None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:55.214962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 152/296] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:55.220363 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87aebc2-d71d-4f98-a959-57ec05231330 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:55.220679 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87aebc2-d71d-4f98-a959-57ec05231330 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:55.220956 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87aebc2-d71d-4f98-a959-57ec05231330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:55.243319 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 145/297] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:55.244107 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-c87aebc2-d71d-4f98-a959-57ec05231330 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:55.245549 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-c87aebc2-d71d-4f98-a959-57ec05231330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:55.315727 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 153/298] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:55.547999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124cef4-dd22-4576-8785-7e74fd32c54d None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:55.548414 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124cef4-dd22-4576-8785-7e74fd32c54d None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:55.548590 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124cef4-dd22-4576-8785-7e74fd32c54d None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:55.550198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 146/299] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:55.555303 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3d248-69b5-4875-90a9-f1b5bf82865c None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:55.555592 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3d248-69b5-4875-90a9-f1b5bf82865c None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:55.555869 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3d248-69b5-4875-90a9-f1b5bf82865c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:55.576058 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-00e3d248-69b5-4875-90a9-f1b5bf82865c None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:55.577408 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-00e3d248-69b5-4875-90a9-f1b5bf82865c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:55.586106 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124cef4-dd22-4576-8785-7e74fd32c54d None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:55.593427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:55.652114 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 154/300] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:55.653703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c56387-49a7-4b9c-b3f3-cd2826aab29a None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:55.653991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c56387-49a7-4b9c-b3f3-cd2826aab29a None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:55.654267 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c56387-49a7-4b9c-b3f3-cd2826aab29a None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:55.655503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 155/301] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:55.656198 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c56387-49a7-4b9c-b3f3-cd2826aab29a None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:55.702295 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124cef4-dd22-4576-8785-7e74fd32c54d None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:55.743010 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52cf7a-183f-40f4-8634-7e1c517b2791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:55.744075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52cf7a-183f-40f4-8634-7e1c517b2791 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:55.744924 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52cf7a-183f-40f4-8634-7e1c517b2791 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:55.745385 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52cf7a-183f-40f4-8634-7e1c517b2791 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:55.747309 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:55.758088 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52cf7a-183f-40f4-8634-7e1c517b2791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:55.763581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-bb52cf7a-183f-40f4-8634-7e1c517b2791 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:32:55.763581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:55.763581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:55.763581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:55.763581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:55.763581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:55.763581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:55.763581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:55.763581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:55.763581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:55.763581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:55.763581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:55.763581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:55.763581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:55.763581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:55.763581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:55.764631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:55.764631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:55.764631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:55.764631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:55.764631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:55.764631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:55.764631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:55.764631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:55.764631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:55.764631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:55.764631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:55.764631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:55.764631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:55.764631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:55.764631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:55.764631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:55.765402 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:55.765402 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:55.765402 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:55.765402 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:55.765402 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:55.765402 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:55.765402 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:55.765402 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:55.765402 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:55.765402 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:55.765402 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:32:55.765402 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:55.766001 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c56387-49a7-4b9c-b3f3-cd2826aab29a None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:55.769591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 147/302] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:32:55.770840 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf45fa0-9be7-4eef-aa7e-223e6379a9b0 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:55.771631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf45fa0-9be7-4eef-aa7e-223e6379a9b0 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:55.771918 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf45fa0-9be7-4eef-aa7e-223e6379a9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:55.789036 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-2cf45fa0-9be7-4eef-aa7e-223e6379a9b0 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:55.790231 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-2cf45fa0-9be7-4eef-aa7e-223e6379a9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:55.803556 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d313b-4c84-4a2f-9b1f-f936c727f703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:55.804120 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d313b-4c84-4a2f-9b1f-f936c727f703 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:55.804437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d313b-4c84-4a2f-9b1f-f936c727f703 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:55.804714 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d313b-4c84-4a2f-9b1f-f936c727f703 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:55.805802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d313b-4c84-4a2f-9b1f-f936c727f703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:55.807327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d313b-4c84-4a2f-9b1f-f936c727f703 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:55.809166 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 156/303] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:55.809814 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d313b-4c84-4a2f-9b1f-f936c727f703 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:55.829917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:55.866274 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 148/304] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:55.867317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf45fa0-9be7-4eef-aa7e-223e6379a9b0 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:55.926798 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d313b-4c84-4a2f-9b1f-f936c727f703 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:55.962762 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e7d7f-5bab-4be0-9619-267034c8b983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:55.963420 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e7d7f-5bab-4be0-9619-267034c8b983 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:55.963697 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e7d7f-5bab-4be0-9619-267034c8b983 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:55.963966 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e7d7f-5bab-4be0-9619-267034c8b983 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:55.968400 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e7d7f-5bab-4be0-9619-267034c8b983 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:55.968400 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e7d7f-5bab-4be0-9619-267034c8b983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:55.968400 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e7d7f-5bab-4be0-9619-267034c8b983 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:55.975352 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 157/305] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:55.976149 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e7d7f-5bab-4be0-9619-267034c8b983 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:55.995616 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf45fa0-9be7-4eef-aa7e-223e6379a9b0 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:56.021563 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:56.035135 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cd00b-1bf7-483f-bc52-add9ff4e77ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:56.035737 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd00b-1bf7-483f-bc52-add9ff4e77ef None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:56.036020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd00b-1bf7-483f-bc52-add9ff4e77ef None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:56.036291 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cd00b-1bf7-483f-bc52-add9ff4e77ef None admin] PATH_INFO: `/v3/groups` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:56.036935 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cd00b-1bf7-483f-bc52-add9ff4e77ef None admin] RBAC: Authorizing `identity:create_group()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:56.038363 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cd00b-1bf7-483f-bc52-add9ff4e77ef None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:56.054125 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 149/306] 10.222.0.61 () {60 vars in 1134 bytes} [Sat Sep 24 20:32:55 2022] POST /identity/v3/groups => generated 229 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:32:56.054863 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cd00b-1bf7-483f-bc52-add9ff4e77ef None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:56.070086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:56.099365 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e7d7f-5bab-4be0-9619-267034c8b983 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:56.152582 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbcbab-d204-4c38-99fa-d92c31e75b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:56.154197 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbcbab-d204-4c38-99fa-d92c31e75b7d None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:56.155923 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbcbab-d204-4c38-99fa-d92c31e75b7d None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:56.156429 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbcbab-d204-4c38-99fa-d92c31e75b7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:56.177841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbcbab-d204-4c38-99fa-d92c31e75b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:56.186005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-53cbcbab-d204-4c38-99fa-d92c31e75b7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:56.186005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:56.186005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:56.186005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:56.186005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:56.186005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:56.186005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:56.186005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:56.186005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:56.186005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:56.186005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:56.186005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:56.186005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:56.186005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:56.186005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:56.186005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:56.186987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:56.186987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:56.186987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:56.186987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:56.186987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:56.186987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:56.186987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:56.186987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:56.186987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:56.186987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:56.186987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:56.186987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:56.186987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:56.186987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:56.186987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:56.186987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:56.187770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:56.187770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:56.187770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:56.187770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:56.187770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:56.187770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:56.187770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:56.187770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:56.187770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:56.187770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:56.187770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:32:56.187770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:32:56.194943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 158/307] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:56.195538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbcbab-d204-4c38-99fa-d92c31e75b7d None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:56.215674 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cd00b-1bf7-483f-bc52-add9ff4e77ef None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:56.260144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111204cd-95b6-4706-8787-09be0440ea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:56.261760 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111204cd-95b6-4706-8787-09be0440ea74 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:56.262058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111204cd-95b6-4706-8787-09be0440ea74 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:56.262344 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111204cd-95b6-4706-8787-09be0440ea74 None admin] PATH_INFO: `/v3/users/3e0f04da7bdd4c6f936bf8a1248b32ca` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:56.280679 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111204cd-95b6-4706-8787-09be0440ea74 None admin] RBAC: Authorizing `identity:get_user(user_id=3e0f04da7bdd4c6f936bf8a1248b32ca)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:56.282209 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111204cd-95b6-4706-8787-09be0440ea74 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:56.284405 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 150/308] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:56 2022] GET /identity/v3/users/3e0f04da7bdd4c6f936bf8a1248b32ca => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:56.285621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111204cd-95b6-4706-8787-09be0440ea74 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:56.313522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbcbab-d204-4c38-99fa-d92c31e75b7d None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:56.334716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:56.350269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bb2cc-4101-4899-bdcc-4151dc4afc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:56.350874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bb2cc-4101-4899-bdcc-4151dc4afc4b None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:56.351156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bb2cc-4101-4899-bdcc-4151dc4afc4b None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:56.351431 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690bb2cc-4101-4899-bdcc-4151dc4afc4b None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:56.352090 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bb2cc-4101-4899-bdcc-4151dc4afc4b None admin] RBAC: Adding query filter params (name=member) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:56.352425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bb2cc-4101-4899-bdcc-4151dc4afc4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:56.353928 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690bb2cc-4101-4899-bdcc-4151dc4afc4b None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:56.359178 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:56.363848 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 159/309] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:56.368976 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bb2cc-4101-4899-bdcc-4151dc4afc4b None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:56.398344 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111204cd-95b6-4706-8787-09be0440ea74 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:56.435409 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedc0f1-6730-48ff-a957-83a5569c1172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:56.436151 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc0f1-6730-48ff-a957-83a5569c1172 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:56.436462 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc0f1-6730-48ff-a957-83a5569c1172 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:56.436834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc0f1-6730-48ff-a957-83a5569c1172 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:56.448267 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedc0f1-6730-48ff-a957-83a5569c1172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:56.453377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-eaedc0f1-6730-48ff-a957-83a5569c1172 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:32:56.453377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:56.453377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:56.453377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:56.453377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:56.453377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:56.453377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:56.453377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:56.453377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:56.453377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:56.453377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:56.453377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:56.453377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:56.453377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:56.453377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:56.453377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:56.454230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:56.454230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:56.454230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:56.454230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:56.454230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:56.454230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:56.454230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:56.454230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:56.454230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:56.454230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:56.454230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:56.454230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:56.454230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:56.454230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:56.454230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:56.454230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:56.455021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:56.455021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:56.455021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:56.455021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:56.455021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:56.455021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:56.455021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:56.455021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:56.455021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:56.455021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:56.455021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:32:56.455021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:56.455021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 151/310] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:32:56.455665 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedc0f1-6730-48ff-a957-83a5569c1172 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:56.471266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690bb2cc-4101-4899-bdcc-4151dc4afc4b None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:56.507232 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8035f02-55e1-40f4-aa0a-12867d2d6b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:56.507974 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8035f02-55e1-40f4-aa0a-12867d2d6b1f None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:56.508261 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8035f02-55e1-40f4-aa0a-12867d2d6b1f None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:56.508565 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8035f02-55e1-40f4-aa0a-12867d2d6b1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:56.509285 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8035f02-55e1-40f4-aa0a-12867d2d6b1f None admin] RBAC: Adding query filter params (role.id=11b3648aadfb4d19b376c5acc9465a44, user.id=3e0f04da7bdd4c6f936bf8a1248b32ca, scope.system=all) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:56.509589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8035f02-55e1-40f4-aa0a-12867d2d6b1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:56.511669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8035f02-55e1-40f4-aa0a-12867d2d6b1f None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:56.517356 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 160/311] 10.222.0.61 () {56 vars in 1308 bytes} [Sat Sep 24 20:32:56 2022] GET /identity/v3/role_assignments?user.id=3e0f04da7bdd4c6f936bf8a1248b32ca&scope.system=all&role.id=11b3648aadfb4d19b376c5acc9465a44 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:56.518256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8035f02-55e1-40f4-aa0a-12867d2d6b1f None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:56.587405 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedc0f1-6730-48ff-a957-83a5569c1172 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:56.589880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:56.591042 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:56.642427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8035f02-55e1-40f4-aa0a-12867d2d6b1f None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:56.657866 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3134006-8b52-47fc-811a-8856ad244bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:56.657866 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3134006-8b52-47fc-811a-8856ad244bda None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:56.657866 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3134006-8b52-47fc-811a-8856ad244bda None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:56.657866 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3134006-8b52-47fc-811a-8856ad244bda None admin] PATH_INFO: `/v3/users/1c2722fa70ef491298cb6d7c71a4d76e` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:56.659083 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3134006-8b52-47fc-811a-8856ad244bda None admin] RBAC: Authorizing `identity:get_user(user_id=1c2722fa70ef491298cb6d7c71a4d76e)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:56.661027 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3134006-8b52-47fc-811a-8856ad244bda None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:56.663502 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 152/312] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:56 2022] GET /identity/v3/users/1c2722fa70ef491298cb6d7c71a4d76e => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:56.669999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3134006-8b52-47fc-811a-8856ad244bda None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:56.685787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bce9a1-e93f-4605-8a8f-f4946aab0954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:56.686801 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bce9a1-e93f-4605-8a8f-f4946aab0954 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:56.687295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bce9a1-e93f-4605-8a8f-f4946aab0954 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:56.687783 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bce9a1-e93f-4605-8a8f-f4946aab0954 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:56.688761 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bce9a1-e93f-4605-8a8f-f4946aab0954 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:56.689259 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bce9a1-e93f-4605-8a8f-f4946aab0954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:56.690907 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bce9a1-e93f-4605-8a8f-f4946aab0954 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:56.700653 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 161/313] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:56.708470 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bce9a1-e93f-4605-8a8f-f4946aab0954 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:56.809234 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3134006-8b52-47fc-811a-8856ad244bda None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:56.829496 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bce9a1-e93f-4605-8a8f-f4946aab0954 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:56.847196 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a1ee7-90f8-4deb-93e4-db1fd24154c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:56.847782 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a1ee7-90f8-4deb-93e4-db1fd24154c2 None admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:56.848060 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a1ee7-90f8-4deb-93e4-db1fd24154c2 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:56.848352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a1ee7-90f8-4deb-93e4-db1fd24154c2 None admin] PATH_INFO: `/v3/system/users/1c2722fa70ef491298cb6d7c71a4d76e/roles/3481273c76dc4a20b3f73c4f8ea558e6` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:56.849766 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a1ee7-90f8-4deb-93e4-db1fd24154c2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1c2722fa70ef491298cb6d7c71a4d76e, role_id=3481273c76dc4a20b3f73c4f8ea558e6)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:56.851151 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a1ee7-90f8-4deb-93e4-db1fd24154c2 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:56.859917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:56.862140 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 153/314] 10.222.0.61 () {58 vars in 1334 bytes} [Sat Sep 24 20:32:56 2022] PUT /identity/v3/system/users/1c2722fa70ef491298cb6d7c71a4d76e/roles/3481273c76dc4a20b3f73c4f8ea558e6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:32:56.876026 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e3df-0093-447f-8291-9d5defd52701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:56.876026 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e3df-0093-447f-8291-9d5defd52701 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:56.876026 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e3df-0093-447f-8291-9d5defd52701 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:56.876026 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e3df-0093-447f-8291-9d5defd52701 None admin] PATH_INFO: `/v3/users/9b6d9cb3119b482893e6ac271adbaa6f` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:56.876504 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4e3df-0093-447f-8291-9d5defd52701 None admin] RBAC: Authorizing `identity:get_user(user_id=9b6d9cb3119b482893e6ac271adbaa6f)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:56.878015 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4e3df-0093-447f-8291-9d5defd52701 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:56.880216 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 162/315] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:56 2022] GET /identity/v3/users/9b6d9cb3119b482893e6ac271adbaa6f => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:56.885797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a1ee7-90f8-4deb-93e4-db1fd24154c2 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:56.932730 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:57.009376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a1ee7-90f8-4deb-93e4-db1fd24154c2 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:57.050913 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dad028-6a05-4d1a-a128-b3e7f186008f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:57.051637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dad028-6a05-4d1a-a128-b3e7f186008f None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:57.052026 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dad028-6a05-4d1a-a128-b3e7f186008f None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:57.052302 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dad028-6a05-4d1a-a128-b3e7f186008f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:57.126128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dad028-6a05-4d1a-a128-b3e7f186008f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:57.127497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dad028-6a05-4d1a-a128-b3e7f186008f None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:57.168675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:57.239108 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 154/316] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:32:57.245069 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e3df-0093-447f-8291-9d5defd52701 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:57.356107 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e3df-0093-447f-8291-9d5defd52701 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:57.392318 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40878b46-7e38-4917-a97e-8ecf38131330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:57.393314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40878b46-7e38-4917-a97e-8ecf38131330 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:57.393845 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40878b46-7e38-4917-a97e-8ecf38131330 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:57.394337 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40878b46-7e38-4917-a97e-8ecf38131330 None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:57.395700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40878b46-7e38-4917-a97e-8ecf38131330 None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:57.397393 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40878b46-7e38-4917-a97e-8ecf38131330 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:57.399613 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 163/317] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:32:57 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:57.405760 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dad028-6a05-4d1a-a128-b3e7f186008f None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:57.513227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dad028-6a05-4d1a-a128-b3e7f186008f None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:57.549574 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663db6bd-d39d-40e9-bac5-6a0c3827fa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:57.550181 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663db6bd-d39d-40e9-bac5-6a0c3827fa3a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:57.550465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663db6bd-d39d-40e9-bac5-6a0c3827fa3a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:57.550741 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663db6bd-d39d-40e9-bac5-6a0c3827fa3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:57.551467 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663db6bd-d39d-40e9-bac5-6a0c3827fa3a None admin] RBAC: Adding query filter params (role.id=11b3648aadfb4d19b376c5acc9465a44, scope.project.id=aa98305d5a0d465b98d3f7ad7d883522, user.id=9b6d9cb3119b482893e6ac271adbaa6f) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:57.551779 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663db6bd-d39d-40e9-bac5-6a0c3827fa3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:57.553250 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663db6bd-d39d-40e9-bac5-6a0c3827fa3a None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:57.554942 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:57.560994 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 155/318] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:32:57 2022] GET /identity/v3/role_assignments?user.id=9b6d9cb3119b482893e6ac271adbaa6f&scope.project.id=aa98305d5a0d465b98d3f7ad7d883522&role.id=11b3648aadfb4d19b376c5acc9465a44 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:58.628737 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dfec9-b017-4d62-aae3-d95485b064d0 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:58.629292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dfec9-b017-4d62-aae3-d95485b064d0 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:58.629292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dfec9-b017-4d62-aae3-d95485b064d0 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:58.630545 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 164/319] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:58.636100 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a8d62-7e8c-4a4e-a264-98a94fa3b96e None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:58.636521 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a8d62-7e8c-4a4e-a264-98a94fa3b96e None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:58.636684 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a8d62-7e8c-4a4e-a264-98a94fa3b96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:58.655881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-739a8d62-7e8c-4a4e-a264-98a94fa3b96e None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:58.657096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-739a8d62-7e8c-4a4e-a264-98a94fa3b96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:58.725417 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 156/320] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:59.002618 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b7fe8-45a9-4c13-a55b-64de92be2c99 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:59.003005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b7fe8-45a9-4c13-a55b-64de92be2c99 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:59.003185 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b7fe8-45a9-4c13-a55b-64de92be2c99 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:59.004650 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 165/321] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:32:59.009697 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812af5a-0fca-414d-8061-60f33d60bf4e None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:59.010033 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812af5a-0fca-414d-8061-60f33d60bf4e None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:59.010412 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812af5a-0fca-414d-8061-60f33d60bf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:59.028932 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-b812af5a-0fca-414d-8061-60f33d60bf4e None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:59.030094 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-b812af5a-0fca-414d-8061-60f33d60bf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:59.047673 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b7fe8-45a9-4c13-a55b-64de92be2c99 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:59.108941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:59.111073 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 157/322] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:32:59.151376 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b7fe8-45a9-4c13-a55b-64de92be2c99 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:59.193902 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6a858-0459-4d80-a53a-f69f8d89b671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:59.194532 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6a858-0459-4d80-a53a-f69f8d89b671 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:59.194811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6a858-0459-4d80-a53a-f69f8d89b671 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:59.195080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6a858-0459-4d80-a53a-f69f8d89b671 None admin] PATH_INFO: `/v3/domains/default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:59.196163 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6a858-0459-4d80-a53a-f69f8d89b671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:59.198227 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6a858-0459-4d80-a53a-f69f8d89b671 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:59.200029 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 166/323] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:32:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:59.205349 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812af5a-0fca-414d-8061-60f33d60bf4e None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:59.264872 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:59.306829 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812af5a-0fca-414d-8061-60f33d60bf4e None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:59.340242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d59b11-586c-4f81-adaf-2ad044441f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:59.340878 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d59b11-586c-4f81-adaf-2ad044441f89 None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:59.341158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d59b11-586c-4f81-adaf-2ad044441f89 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:59.341430 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d59b11-586c-4f81-adaf-2ad044441f89 None admin] PATH_INFO: `/v3/groups` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:59.342066 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d59b11-586c-4f81-adaf-2ad044441f89 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:59.343485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d59b11-586c-4f81-adaf-2ad044441f89 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:59.350239 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3f107-fa0b-4f20-ae37-c7f3cc66a763 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:59.350694 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3f107-fa0b-4f20-ae37-c7f3cc66a763 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:59.351087 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3f107-fa0b-4f20-ae37-c7f3cc66a763 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:59.353045 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 167/324] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:32:59.358619 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401aff6-e389-4bc2-a216-2b339a931f93 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:59.358902 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401aff6-e389-4bc2-a216-2b339a931f93 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:59.359173 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401aff6-e389-4bc2-a216-2b339a931f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:59.368372 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 158/325] 10.222.0.61 () {60 vars in 1134 bytes} [Sat Sep 24 20:32:59 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:32:59.378967 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-9401aff6-e389-4bc2-a216-2b339a931f93 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:32:59.380184 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-9401aff6-e389-4bc2-a216-2b339a931f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:32:59.438097 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d59b11-586c-4f81-adaf-2ad044441f89 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:59.458624 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 168/326] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:32:59.555028 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d59b11-586c-4f81-adaf-2ad044441f89 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:59.577994 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:59.595331 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac0387-7a02-4d12-a4fc-4ad2f12c2d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:59.595969 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac0387-7a02-4d12-a4fc-4ad2f12c2d18 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:59.596260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac0387-7a02-4d12-a4fc-4ad2f12c2d18 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:59.596580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac0387-7a02-4d12-a4fc-4ad2f12c2d18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:59.609658 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac0387-7a02-4d12-a4fc-4ad2f12c2d18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:32:59.615147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-98ac0387-7a02-4d12-a4fc-4ad2f12c2d18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:32:59.615147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:32:59.615147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:32:59.615147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:32:59.615147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:32:59.615147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:32:59.615147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:32:59.615147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:32:59.615147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:32:59.615147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:32:59.615147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:32:59.615147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:32:59.615147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:32:59.615147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:32:59.615147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:32:59.615147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:32:59.616072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:32:59.616072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:32:59.616072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:32:59.616072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:32:59.616072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:32:59.616072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:32:59.616072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:32:59.616072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:32:59.616072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:32:59.616072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:32:59.616072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:32:59.616072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:32:59.616072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:32:59.616072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:32:59.616072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:32:59.616072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:32:59.616952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:32:59.616952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:32:59.616952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:32:59.616952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:32:59.616952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:32:59.616952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:32:59.616952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:32:59.616952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:32:59.616952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:32:59.616952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:32:59.616952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:32:59.616952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:32:59.620068 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 159/327] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:32:59.622915 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401aff6-e389-4bc2-a216-2b339a931f93 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:59.688519 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:59.733118 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401aff6-e389-4bc2-a216-2b339a931f93 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:59.770572 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf9cf1-1af9-4e4f-bdd2-13ed330b311d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:59.771194 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf9cf1-1af9-4e4f-bdd2-13ed330b311d None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:59.771477 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf9cf1-1af9-4e4f-bdd2-13ed330b311d None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:59.771753 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf9cf1-1af9-4e4f-bdd2-13ed330b311d None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:59.775791 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf9cf1-1af9-4e4f-bdd2-13ed330b311d None admin] RBAC: Adding query filter params (name=reader) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:32:59.775791 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf9cf1-1af9-4e4f-bdd2-13ed330b311d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:59.775791 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf9cf1-1af9-4e4f-bdd2-13ed330b311d None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:59.783158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 169/328] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:32:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:32:59.787271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac0387-7a02-4d12-a4fc-4ad2f12c2d18 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:59.788479 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf9cf1-1af9-4e4f-bdd2-13ed330b311d None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:59.906204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf9cf1-1af9-4e4f-bdd2-13ed330b311d None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:59.927821 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac0387-7a02-4d12-a4fc-4ad2f12c2d18 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:32:59.940177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:32:59.961082 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af87eb-078b-49b4-a465-8c471fb4534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:59.961883 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af87eb-078b-49b4-a465-8c471fb4534b None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:59.962534 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af87eb-078b-49b4-a465-8c471fb4534b None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:59.962808 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af87eb-078b-49b4-a465-8c471fb4534b None admin] PATH_INFO: `/v3/users/3e0f04da7bdd4c6f936bf8a1248b32ca` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:59.964821 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af87eb-078b-49b4-a465-8c471fb4534b None admin] RBAC: Authorizing `identity:get_user(user_id=3e0f04da7bdd4c6f936bf8a1248b32ca)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:32:59.966453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af87eb-078b-49b4-a465-8c471fb4534b None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:32:59.968700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 170/329] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:32:59 2022] GET /identity/v3/users/3e0f04da7bdd4c6f936bf8a1248b32ca => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:32:59.975966 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af87eb-078b-49b4-a465-8c471fb4534b None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:32:59.978570 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9128de0-e689-42a3-aaf9-7ae43903b8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:32:59.979249 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9128de0-e689-42a3-aaf9-7ae43903b8d7 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:32:59.979582 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9128de0-e689-42a3-aaf9-7ae43903b8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:32:59.980116 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9128de0-e689-42a3-aaf9-7ae43903b8d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:32:59.996883 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9128de0-e689-42a3-aaf9-7ae43903b8d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:00.003752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-b9128de0-e689-42a3-aaf9-7ae43903b8d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:33:00.003752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:00.003752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:00.003752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:00.003752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:00.003752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:00.003752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:00.003752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:00.003752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:00.003752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:00.003752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:00.003752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:00.003752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:00.003752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:00.003752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:00.003752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:00.004693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:00.004693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:00.004693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:00.004693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:00.004693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:00.004693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:00.004693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:00.004693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:00.004693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:00.004693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:00.004693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:00.004693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:00.004693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:00.004693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:00.004693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:00.004693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:00.005940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:00.005940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:00.005940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:00.005940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:00.005940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:00.005940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:00.005940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:00.005940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:00.005940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:00.005940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:00.005940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:33:00.005940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:00.005940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 160/330] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:32:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:00.012594 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9128de0-e689-42a3-aaf9-7ae43903b8d7 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:00.076564 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:00.121786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af87eb-078b-49b4-a465-8c471fb4534b None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:00.160077 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9128de0-e689-42a3-aaf9-7ae43903b8d7 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:00.183376 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41382941-7611-4df7-9d29-2b80c4f96234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:00.184574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41382941-7611-4df7-9d29-2b80c4f96234 None admin] REQUEST_METHOD: `PUT` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:00.185230 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41382941-7611-4df7-9d29-2b80c4f96234 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:00.185731 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41382941-7611-4df7-9d29-2b80c4f96234 None admin] PATH_INFO: `/v3/system/users/3e0f04da7bdd4c6f936bf8a1248b32ca/roles/11b3648aadfb4d19b376c5acc9465a44` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:00.188157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41382941-7611-4df7-9d29-2b80c4f96234 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3e0f04da7bdd4c6f936bf8a1248b32ca, role_id=11b3648aadfb4d19b376c5acc9465a44)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:00.190312 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41382941-7611-4df7-9d29-2b80c4f96234 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:00.203619 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 171/331] 10.222.0.61 () {58 vars in 1334 bytes} [Sat Sep 24 20:32:59 2022] PUT /identity/v3/system/users/3e0f04da7bdd4c6f936bf8a1248b32ca/roles/11b3648aadfb4d19b376c5acc9465a44 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:33:00.215916 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e43b4-ab48-43e5-b8fa-79950cc54493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:00.217372 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e43b4-ab48-43e5-b8fa-79950cc54493 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:00.217372 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e43b4-ab48-43e5-b8fa-79950cc54493 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:00.217372 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e43b4-ab48-43e5-b8fa-79950cc54493 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:00.217801 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e43b4-ab48-43e5-b8fa-79950cc54493 None admin] RBAC: Adding query filter params (name=member) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:00.218100 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e43b4-ab48-43e5-b8fa-79950cc54493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:00.219484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e43b4-ab48-43e5-b8fa-79950cc54493 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:00.232308 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 161/332] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:33:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:00.238140 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41382941-7611-4df7-9d29-2b80c4f96234 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:00.309557 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:00.363335 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41382941-7611-4df7-9d29-2b80c4f96234 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:00.407986 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcd7e9-3cc9-4e84-b83d-843eb72efbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:00.408717 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcd7e9-3cc9-4e84-b83d-843eb72efbf9 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:00.408991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcd7e9-3cc9-4e84-b83d-843eb72efbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:00.409260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcd7e9-3cc9-4e84-b83d-843eb72efbf9 None admin] PATH_INFO: `/v3/users/1c2722fa70ef491298cb6d7c71a4d76e` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:00.411293 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bcd7e9-3cc9-4e84-b83d-843eb72efbf9 None admin] RBAC: Authorizing `identity:get_user(user_id=1c2722fa70ef491298cb6d7c71a4d76e)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:00.412876 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bcd7e9-3cc9-4e84-b83d-843eb72efbf9 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:00.414876 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 172/333] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:33:00 2022] GET /identity/v3/users/1c2722fa70ef491298cb6d7c71a4d76e => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:00.421578 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e43b4-ab48-43e5-b8fa-79950cc54493 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:00.532699 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:00.536270 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e43b4-ab48-43e5-b8fa-79950cc54493 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:00.575668 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35e433-a4d3-4af7-862f-12467ec3a27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:00.576280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e433-a4d3-4af7-862f-12467ec3a27d None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:00.576589 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e433-a4d3-4af7-862f-12467ec3a27d None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:00.576868 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35e433-a4d3-4af7-862f-12467ec3a27d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:00.577606 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35e433-a4d3-4af7-862f-12467ec3a27d None admin] RBAC: Adding query filter params (role.id=3481273c76dc4a20b3f73c4f8ea558e6, user.id=1c2722fa70ef491298cb6d7c71a4d76e, scope.system=all) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:00.577920 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35e433-a4d3-4af7-862f-12467ec3a27d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:00.579411 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35e433-a4d3-4af7-862f-12467ec3a27d None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:00.592556 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 162/334] 10.222.0.61 () {56 vars in 1308 bytes} [Sat Sep 24 20:33:00 2022] GET /identity/v3/role_assignments?user.id=1c2722fa70ef491298cb6d7c71a4d76e&scope.system=all&role.id=3481273c76dc4a20b3f73c4f8ea558e6 => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:02.173414 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c51625-e998-4c43-aadb-6fd06064d297 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:02.174346 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c51625-e998-4c43-aadb-6fd06064d297 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:02.174836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c51625-e998-4c43-aadb-6fd06064d297 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:02.176654 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 173/335] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:02.182658 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8ee03-8697-4d9c-b395-23c49e23605e None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:02.183508 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8ee03-8697-4d9c-b395-23c49e23605e None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:02.184099 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8ee03-8697-4d9c-b395-23c49e23605e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:02.207978 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-76b8ee03-8697-4d9c-b395-23c49e23605e None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:02.209567 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-76b8ee03-8697-4d9c-b395-23c49e23605e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:02.285534 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 163/336] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:02.638666 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c51625-e998-4c43-aadb-6fd06064d297 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:02.748947 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c51625-e998-4c43-aadb-6fd06064d297 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:02.776934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:02.786820 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe615f1-6411-4dea-b866-587cf0125c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:02.787846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe615f1-6411-4dea-b866-587cf0125c70 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:02.788403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe615f1-6411-4dea-b866-587cf0125c70 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:02.788914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe615f1-6411-4dea-b866-587cf0125c70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:02.805204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe615f1-6411-4dea-b866-587cf0125c70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:02.811349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-cbe615f1-6411-4dea-b866-587cf0125c70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:33:02.811349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:02.811349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:02.811349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:02.811349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:02.811349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:02.811349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:02.811349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:02.811349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:02.811349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:02.811349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:02.811349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:02.811349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:02.811349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:02.811349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:02.811349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:02.812427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:02.812427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:02.812427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:02.812427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:02.812427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:02.812427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:02.812427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:02.812427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:02.812427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:02.812427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:02.812427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:02.812427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:02.812427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:02.812427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:02.812427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:02.812427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:02.813397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:02.813397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:02.813397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:02.813397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:02.813397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:02.813397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:02.813397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:02.813397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:02.813397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:02.813397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:02.813397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:33:02.813397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:02.816146 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 174/337] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:02.822687 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8ee03-8697-4d9c-b395-23c49e23605e None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:02.926394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:02.942680 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8ee03-8697-4d9c-b395-23c49e23605e None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:02.982209 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df329367-3209-4be9-86eb-de887ff6c27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:02.983220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df329367-3209-4be9-86eb-de887ff6c27b None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:02.983750 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df329367-3209-4be9-86eb-de887ff6c27b None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:02.984256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df329367-3209-4be9-86eb-de887ff6c27b None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:02.985222 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df329367-3209-4be9-86eb-de887ff6c27b None admin] RBAC: Adding query filter params (name=member) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:02.985729 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df329367-3209-4be9-86eb-de887ff6c27b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:02.987373 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df329367-3209-4be9-86eb-de887ff6c27b None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:02.997615 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 164/338] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:33:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:03.003749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe615f1-6411-4dea-b866-587cf0125c70 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:03.113589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe615f1-6411-4dea-b866-587cf0125c70 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:03.149835 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fc3a3-8e0f-46ac-bbe6-b6bd03712069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:03.150917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fc3a3-8e0f-46ac-bbe6-b6bd03712069 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:03.151413 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fc3a3-8e0f-46ac-bbe6-b6bd03712069 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:03.151926 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fc3a3-8e0f-46ac-bbe6-b6bd03712069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:03.237125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:03.260961 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fc3a3-8e0f-46ac-bbe6-b6bd03712069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:03.262431 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fc3a3-8e0f-46ac-bbe6-b6bd03712069 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:03.345989 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e5d16-4b8e-4876-8a22-4cf48e0cedc0 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:03.346966 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e5d16-4b8e-4876-8a22-4cf48e0cedc0 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:03.347464 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e5d16-4b8e-4876-8a22-4cf48e0cedc0 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:03.349034 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 165/339] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:33:03.361706 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f8aa0-f9df-457c-9526-688b69397a19 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:03.362319 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f8aa0-f9df-457c-9526-688b69397a19 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:03.362836 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f8aa0-f9df-457c-9526-688b69397a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:03.397470 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-648f8aa0-f9df-457c-9526-688b69397a19 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:03.399999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-648f8aa0-f9df-457c-9526-688b69397a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:03.419322 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 175/340] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:03.428804 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fc3a3-8e0f-46ac-bbe6-b6bd03712069 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:03.525835 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 166/341] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:03.584716 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:03.595503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fc3a3-8e0f-46ac-bbe6-b6bd03712069 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:03.645235 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f141c-dfa1-440b-8e68-35dd3661a127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:03.646254 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f141c-dfa1-440b-8e68-35dd3661a127 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:03.646756 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f141c-dfa1-440b-8e68-35dd3661a127 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:03.647224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f141c-dfa1-440b-8e68-35dd3661a127 None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:03.652200 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f141c-dfa1-440b-8e68-35dd3661a127 None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:03.654682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f141c-dfa1-440b-8e68-35dd3661a127 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:03.657125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 176/342] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:33:03 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:33:03.663672 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f8aa0-f9df-457c-9526-688b69397a19 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:03.760843 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:03.781808 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f8aa0-f9df-457c-9526-688b69397a19 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:03.830448 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35560c5e-455b-4c85-a6ce-9605d4925b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:03.831097 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35560c5e-455b-4c85-a6ce-9605d4925b3f None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:03.831378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35560c5e-455b-4c85-a6ce-9605d4925b3f None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:03.831654 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35560c5e-455b-4c85-a6ce-9605d4925b3f None admin] PATH_INFO: `/v3/groups/8da22d9b508c45438aa1530d1d88a535` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:03.841392 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35560c5e-455b-4c85-a6ce-9605d4925b3f None admin] RBAC: Authorizing `identity:get_group(group_id=8da22d9b508c45438aa1530d1d88a535)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:03.842847 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35560c5e-455b-4c85-a6ce-9605d4925b3f None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:03.844860 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 167/343] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Sep 24 20:33:03 2022] GET /identity/v3/groups/8da22d9b508c45438aa1530d1d88a535 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:03.850588 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f141c-dfa1-440b-8e68-35dd3661a127 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:03.999004 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f141c-dfa1-440b-8e68-35dd3661a127 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:04.049609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636aff3-17d5-475c-b228-010c9ab1fb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:04.050615 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636aff3-17d5-475c-b228-010c9ab1fb41 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:04.051092 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636aff3-17d5-475c-b228-010c9ab1fb41 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:04.051544 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636aff3-17d5-475c-b228-010c9ab1fb41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:04.052498 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636aff3-17d5-475c-b228-010c9ab1fb41 None admin] RBAC: Adding query filter params (group.id=8da22d9b508c45438aa1530d1d88a535, role.id=3481273c76dc4a20b3f73c4f8ea558e6, scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:04.052993 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636aff3-17d5-475c-b228-010c9ab1fb41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:04.054686 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636aff3-17d5-475c-b228-010c9ab1fb41 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:04.062162 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 177/344] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Sep 24 20:33:03 2022] GET /identity/v3/role_assignments?group.id=8da22d9b508c45438aa1530d1d88a535&scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa&role.id=3481273c76dc4a20b3f73c4f8ea558e6 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:04.348511 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d401486-9499-483b-9568-dd2308a58515 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:04.349007 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d401486-9499-483b-9568-dd2308a58515 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:04.349007 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d401486-9499-483b-9568-dd2308a58515 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:04.350311 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 168/345] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:04.356172 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a7b3f-a50c-49b4-a9f3-d2c1bb52a3e9 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:04.356644 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d401486-9499-483b-9568-dd2308a58515 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:04.357138 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a7b3f-a50c-49b4-a9f3-d2c1bb52a3e9 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:04.357627 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a7b3f-a50c-49b4-a9f3-d2c1bb52a3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:04.377983 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-722a7b3f-a50c-49b4-a9f3-d2c1bb52a3e9 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:04.379518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-722a7b3f-a50c-49b4-a9f3-d2c1bb52a3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:04.390339 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:04.500949 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 178/346] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:33:04.535900 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d401486-9499-483b-9568-dd2308a58515 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:04.575871 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f45c4-a4ab-4c23-9425-8cb12af4bc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:04.576541 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f45c4-a4ab-4c23-9425-8cb12af4bc7e None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:04.576827 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f45c4-a4ab-4c23-9425-8cb12af4bc7e None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:04.577105 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f45c4-a4ab-4c23-9425-8cb12af4bc7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:04.591646 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f45c4-a4ab-4c23-9425-8cb12af4bc7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:04.597261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-7b2f45c4-a4ab-4c23-9425-8cb12af4bc7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:33:04.597261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:04.597261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:04.597261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:04.597261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:04.597261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:04.597261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:04.597261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:04.597261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:04.597261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:04.597261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:04.597261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:04.597261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:04.597261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:04.597261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:04.597261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:04.598137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:04.598137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:04.598137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:04.598137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:04.598137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:04.598137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:04.598137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:04.598137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:04.598137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:04.598137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:04.598137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:04.598137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:04.598137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:04.598137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:04.598137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:04.598137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:04.598984 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:04.598984 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:04.598984 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:04.598984 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:04.598984 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:04.598984 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:04.598984 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:04.598984 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:04.598984 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:04.598984 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:04.598984 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:33:04.598984 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:04.598984 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 169/347] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:33:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:33:04.604801 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a7b3f-a50c-49b4-a9f3-d2c1bb52a3e9 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:04.648096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bd62a-dc55-4d74-b90e-c1f736cf44ac None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:04.648419 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bd62a-dc55-4d74-b90e-c1f736cf44ac None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:04.648987 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bd62a-dc55-4d74-b90e-c1f736cf44ac None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:04.650654 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 170/348] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:04.656563 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05e1ae-9d7c-4ab3-ad00-2416b20ee941 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:04.656853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05e1ae-9d7c-4ab3-ad00-2416b20ee941 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:04.657131 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05e1ae-9d7c-4ab3-ad00-2416b20ee941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:04.669525 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:04.687724 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-4d05e1ae-9d7c-4ab3-ad00-2416b20ee941 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:04.689028 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-4d05e1ae-9d7c-4ab3-ad00-2416b20ee941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:04.811403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a7b3f-a50c-49b4-a9f3-d2c1bb52a3e9 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:04.818672 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 171/349] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:04.819966 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c8750-f613-40c2-8cc7-73137d8ae375 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:04.820254 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c8750-f613-40c2-8cc7-73137d8ae375 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:04.820560 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c8750-f613-40c2-8cc7-73137d8ae375 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:04.821934 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 172/350] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:04.834044 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d4a3b-b3cc-4339-973f-abec19eefead None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:04.834330 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d4a3b-b3cc-4339-973f-abec19eefead None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:04.834608 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d4a3b-b3cc-4339-973f-abec19eefead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:04.869674 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-389d4a3b-b3cc-4339-973f-abec19eefead None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:04.870804 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-389d4a3b-b3cc-4339-973f-abec19eefead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:04.894041 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b283436-329a-44c1-9695-e25ee8d879c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:04.894921 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b283436-329a-44c1-9695-e25ee8d879c0 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:04.895285 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b283436-329a-44c1-9695-e25ee8d879c0 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:04.895614 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b283436-329a-44c1-9695-e25ee8d879c0 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:04.896526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b283436-329a-44c1-9695-e25ee8d879c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:04.896889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b283436-329a-44c1-9695-e25ee8d879c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:04.898519 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b283436-329a-44c1-9695-e25ee8d879c0 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:04.918748 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 179/351] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:04.920942 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e707ac-40c6-4b71-adf9-9f31825acd14 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:04.921469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e707ac-40c6-4b71-adf9-9f31825acd14 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:04.921973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e707ac-40c6-4b71-adf9-9f31825acd14 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:04.924215 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 180/352] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:04.929922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77c37a-24fe-4009-972e-1a2403005162 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:04.930199 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77c37a-24fe-4009-972e-1a2403005162 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:04.930475 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77c37a-24fe-4009-972e-1a2403005162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:04.953000 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:04.954376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 173/353] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:04.955252 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d4a3b-b3cc-4339-973f-abec19eefead None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:04.965948 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-7c77c37a-24fe-4009-972e-1a2403005162 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:04.967153 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-7c77c37a-24fe-4009-972e-1a2403005162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:05.044741 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:05.066917 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d4a3b-b3cc-4339-973f-abec19eefead None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:05.109368 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b35219-80f0-440a-8009-91c9349d2dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:05.110135 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b35219-80f0-440a-8009-91c9349d2dcf None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:05.110635 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b35219-80f0-440a-8009-91c9349d2dcf None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:05.111094 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b35219-80f0-440a-8009-91c9349d2dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:05.122010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 181/354] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:33:05.122815 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77c37a-24fe-4009-972e-1a2403005162 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:05.214909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b35219-80f0-440a-8009-91c9349d2dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:05.216474 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b35219-80f0-440a-8009-91c9349d2dcf None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:05.327676 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77c37a-24fe-4009-972e-1a2403005162 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:05.348462 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:05.383421 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf117274-cc9a-4376-b1b0-c3da67029144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:05.384789 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf117274-cc9a-4376-b1b0-c3da67029144 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:05.386910 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf117274-cc9a-4376-b1b0-c3da67029144 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:05.387370 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf117274-cc9a-4376-b1b0-c3da67029144 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:05.399905 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:05.410084 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf117274-cc9a-4376-b1b0-c3da67029144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:05.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-bf117274-cc9a-4376-b1b0-c3da67029144 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:33:05.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:05.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:05.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:05.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:05.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:05.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:05.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:05.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:05.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:05.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:05.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:05.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:05.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:05.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:05.414953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:05.416439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:05.416439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:05.416439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:05.416439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:05.416439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:05.416439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:05.416439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:05.416439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:05.416439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:05.416439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:05.416439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:05.416439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:05.416439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:05.416439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:05.416439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:05.416439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:05.417525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:05.417525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:05.417525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:05.417525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:05.417525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:05.417525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:05.417525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:05.417525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:05.417525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:05.417525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:05.417525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:33:05.417525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:05.421920 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 182/355] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:05.422919 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf117274-cc9a-4376-b1b0-c3da67029144 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:05.430053 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 174/356] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:05.438690 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b35219-80f0-440a-8009-91c9349d2dcf None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:05.549756 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b35219-80f0-440a-8009-91c9349d2dcf None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:05.588000 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13851d-c0b6-4694-a90f-6ef3319e9137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:05.588657 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13851d-c0b6-4694-a90f-6ef3319e9137 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:05.588939 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13851d-c0b6-4694-a90f-6ef3319e9137 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:05.589218 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13851d-c0b6-4694-a90f-6ef3319e9137 None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:05.590374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13851d-c0b6-4694-a90f-6ef3319e9137 None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:05.592656 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13851d-c0b6-4694-a90f-6ef3319e9137 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:05.593775 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 175/357] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:33:05 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:33:05.594574 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13851d-c0b6-4694-a90f-6ef3319e9137 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:05.606370 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf117274-cc9a-4376-b1b0-c3da67029144 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:05.636081 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:05.654983 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fcfb0-f974-4bea-8217-838cf4eace4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:05.655789 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fcfb0-f974-4bea-8217-838cf4eace4d None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:05.656076 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fcfb0-f974-4bea-8217-838cf4eace4d None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:05.656371 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50fcfb0-f974-4bea-8217-838cf4eace4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:05.669511 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50fcfb0-f974-4bea-8217-838cf4eace4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:05.674373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-a50fcfb0-f974-4bea-8217-838cf4eace4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:33:05.674373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:05.674373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:05.674373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:05.674373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:05.674373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:05.674373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:05.674373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:05.674373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:05.674373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:05.674373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:05.674373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:05.674373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:05.674373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:05.674373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:05.674373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:05.675292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:05.675292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:05.675292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:05.675292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:05.675292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:05.675292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:05.675292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:05.675292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:05.675292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:05.675292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:05.675292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:05.675292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:05.675292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:05.675292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:05.675292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:05.675292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:05.676086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:05.676086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:05.676086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:05.676086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:05.676086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:05.676086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:05.676086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:05.676086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:05.676086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:05.676086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:05.676086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:33:05.676086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:05.676086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 183/358] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:33:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:05.677459 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fcfb0-f974-4bea-8217-838cf4eace4d None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:05.738397 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13851d-c0b6-4694-a90f-6ef3319e9137 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:05.760773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:05.795860 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802ab65-bb6b-4561-a1cd-4461e23df5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:05.796763 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802ab65-bb6b-4561-a1cd-4461e23df5fd None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:05.797250 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802ab65-bb6b-4561-a1cd-4461e23df5fd None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:05.797640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802ab65-bb6b-4561-a1cd-4461e23df5fd None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:05.798314 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802ab65-bb6b-4561-a1cd-4461e23df5fd None admin] RBAC: Adding query filter params (name=member) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:05.798619 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802ab65-bb6b-4561-a1cd-4461e23df5fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:05.800110 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802ab65-bb6b-4561-a1cd-4461e23df5fd None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:05.812011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 176/359] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:33:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:05.813283 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802ab65-bb6b-4561-a1cd-4461e23df5fd None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:05.828650 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50fcfb0-f974-4bea-8217-838cf4eace4d None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:05.876222 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964d87e-c1dd-46d3-a65a-fff80e2f90b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:05.876907 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964d87e-c1dd-46d3-a65a-fff80e2f90b5 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:05.877194 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964d87e-c1dd-46d3-a65a-fff80e2f90b5 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:05.877470 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964d87e-c1dd-46d3-a65a-fff80e2f90b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:05.890272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964d87e-c1dd-46d3-a65a-fff80e2f90b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:05.895112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-e964d87e-c1dd-46d3-a65a-fff80e2f90b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:33:05.895112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:05.895112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:05.895112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:05.895112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:05.895112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:05.895112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:05.895112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:05.895112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:05.895112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:05.895112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:05.895112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:05.895112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:05.895112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:05.895112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:05.895112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:05.896018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:05.896018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:05.896018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:05.896018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:05.896018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:05.896018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:05.896018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:05.896018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:05.896018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:05.896018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:05.896018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:05.896018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:05.896018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:05.896018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:05.896018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:05.896018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:05.896941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:05.896941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:05.896941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:05.896941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:05.896941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:05.896941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:05.896941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:05.896941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:05.896941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:05.896941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:05.896941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 20:33:05.896941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:05.896941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 184/360] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:05.897694 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964d87e-c1dd-46d3-a65a-fff80e2f90b5 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:05.942833 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:05.951259 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802ab65-bb6b-4561-a1cd-4461e23df5fd None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:05.995783 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d601d5-cc1f-4e57-a659-6fa79f91283c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:05.996637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d601d5-cc1f-4e57-a659-6fa79f91283c None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:05.996920 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d601d5-cc1f-4e57-a659-6fa79f91283c None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:05.998002 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d601d5-cc1f-4e57-a659-6fa79f91283c None admin] PATH_INFO: `/v3/groups/8da22d9b508c45438aa1530d1d88a535` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:05.999256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d601d5-cc1f-4e57-a659-6fa79f91283c None admin] RBAC: Authorizing `identity:get_group(group_id=8da22d9b508c45438aa1530d1d88a535)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:06.000824 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d601d5-cc1f-4e57-a659-6fa79f91283c None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:06.002417 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 177/361] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Sep 24 20:33:05 2022] GET /identity/v3/groups/8da22d9b508c45438aa1530d1d88a535 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:06.003178 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d601d5-cc1f-4e57-a659-6fa79f91283c None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:06.044048 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964d87e-c1dd-46d3-a65a-fff80e2f90b5 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:06.070398 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:06.095139 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecaebe-9d1b-4bd0-825b-9df915b75e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:06.095775 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecaebe-9d1b-4bd0-825b-9df915b75e14 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:06.096257 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecaebe-9d1b-4bd0-825b-9df915b75e14 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:06.096790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecaebe-9d1b-4bd0-825b-9df915b75e14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:06.113010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecaebe-9d1b-4bd0-825b-9df915b75e14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:06.118602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-07ecaebe-9d1b-4bd0-825b-9df915b75e14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:33:06.118602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:06.118602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:06.118602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:06.118602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:06.118602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:06.118602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:06.118602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:06.118602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:06.118602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:06.118602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:06.118602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:06.118602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:06.118602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:06.118602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:06.118602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:06.119510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:06.119510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:06.119510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:06.119510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:06.119510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:06.119510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:06.119510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:06.119510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:06.119510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:06.119510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:06.119510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:06.119510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:06.119510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:06.119510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:06.119510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:06.119510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:06.120391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:06.120391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:06.120391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:06.120391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:06.120391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:06.120391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:06.120391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:06.120391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:06.120391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:06.120391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:06.120391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:33:06.120391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:06.120391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 185/362] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:33:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:06.121522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecaebe-9d1b-4bd0-825b-9df915b75e14 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:06.165694 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d601d5-cc1f-4e57-a659-6fa79f91283c None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:06.223572 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102749f-6a69-4317-a26a-ea90e360b099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:06.224311 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102749f-6a69-4317-a26a-ea90e360b099 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:06.224674 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102749f-6a69-4317-a26a-ea90e360b099 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:06.224954 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102749f-6a69-4317-a26a-ea90e360b099 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:06.225621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102749f-6a69-4317-a26a-ea90e360b099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:06.225930 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102749f-6a69-4317-a26a-ea90e360b099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:06.227318 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102749f-6a69-4317-a26a-ea90e360b099 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:06.240095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 178/363] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:06.241330 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102749f-6a69-4317-a26a-ea90e360b099 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:06.271754 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecaebe-9d1b-4bd0-825b-9df915b75e14 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:06.278248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:06.322952 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49edd83-8ba6-48b7-ba68-2478cb4befca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:06.322952 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49edd83-8ba6-48b7-ba68-2478cb4befca None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:06.322952 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49edd83-8ba6-48b7-ba68-2478cb4befca None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:06.322952 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49edd83-8ba6-48b7-ba68-2478cb4befca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:06.392663 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:06.393253 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102749f-6a69-4317-a26a-ea90e360b099 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:06.430920 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce37e8b-d672-4260-b29b-4ef9fe35dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:06.432096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce37e8b-d672-4260-b29b-4ef9fe35dee2 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:06.432482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce37e8b-d672-4260-b29b-4ef9fe35dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:06.432793 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce37e8b-d672-4260-b29b-4ef9fe35dee2 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:06.433455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce37e8b-d672-4260-b29b-4ef9fe35dee2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:06.433759 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce37e8b-d672-4260-b29b-4ef9fe35dee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:06.435127 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce37e8b-d672-4260-b29b-4ef9fe35dee2 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:06.436608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49edd83-8ba6-48b7-ba68-2478cb4befca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:06.438051 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49edd83-8ba6-48b7-ba68-2478cb4befca None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:06.444203 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 179/364] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:33:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:06.448534 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce37e8b-d672-4260-b29b-4ef9fe35dee2 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:06.551023 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:06.569981 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 186/365] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:06.571308 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49edd83-8ba6-48b7-ba68-2478cb4befca None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:06.573795 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce37e8b-d672-4260-b29b-4ef9fe35dee2 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:06.619579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425b712-e5fb-40f7-9ace-0e63c6d7da5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:06.621024 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425b712-e5fb-40f7-9ace-0e63c6d7da5d None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:06.621312 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425b712-e5fb-40f7-9ace-0e63c6d7da5d None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:06.621587 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425b712-e5fb-40f7-9ace-0e63c6d7da5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:06.622360 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425b712-e5fb-40f7-9ace-0e63c6d7da5d None admin] RBAC: Adding query filter params (group.id=8da22d9b508c45438aa1530d1d88a535, role.id=905829118b764aa9920810cb3b86e0ce, scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:06.622674 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425b712-e5fb-40f7-9ace-0e63c6d7da5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:06.624930 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3425b712-e5fb-40f7-9ace-0e63c6d7da5d None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:06.632047 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 180/366] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Sep 24 20:33:06 2022] GET /identity/v3/role_assignments?group.id=8da22d9b508c45438aa1530d1d88a535&scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa&role.id=905829118b764aa9920810cb3b86e0ce => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:06.633303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425b712-e5fb-40f7-9ace-0e63c6d7da5d None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:06.671931 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:06.703553 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49edd83-8ba6-48b7-ba68-2478cb4befca None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:06.756823 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee19b3-8ed2-4a0a-924a-181684d2badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:06.757500 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee19b3-8ed2-4a0a-924a-181684d2badb None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:06.757782 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee19b3-8ed2-4a0a-924a-181684d2badb None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:06.758118 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee19b3-8ed2-4a0a-924a-181684d2badb None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:06.758813 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee19b3-8ed2-4a0a-924a-181684d2badb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:06.759118 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee19b3-8ed2-4a0a-924a-181684d2badb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:06.761368 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee19b3-8ed2-4a0a-924a-181684d2badb None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:06.773951 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 187/367] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:06.774175 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee19b3-8ed2-4a0a-924a-181684d2badb None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:06.778849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425b712-e5fb-40f7-9ace-0e63c6d7da5d None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:06.826298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb5cd6-7188-427f-a57e-11be20724814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:06.826926 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb5cd6-7188-427f-a57e-11be20724814 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:06.827205 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb5cd6-7188-427f-a57e-11be20724814 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:06.827477 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb5cd6-7188-427f-a57e-11be20724814 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:06.852627 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:06.919077 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee19b3-8ed2-4a0a-924a-181684d2badb None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:06.924382 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb5cd6-7188-427f-a57e-11be20724814 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:06.926139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb5cd6-7188-427f-a57e-11be20724814 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:06.968196 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a9a62-98a9-4ebd-a1b9-b8e76bff3b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:06.969729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a9a62-98a9-4ebd-a1b9-b8e76bff3b3f None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:06.970017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a9a62-98a9-4ebd-a1b9-b8e76bff3b3f None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:06.970353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a9a62-98a9-4ebd-a1b9-b8e76bff3b3f None admin] PATH_INFO: `/v3/users/3e0f04da7bdd4c6f936bf8a1248b32ca` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:06.971516 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a9a62-98a9-4ebd-a1b9-b8e76bff3b3f None admin] RBAC: Authorizing `identity:get_user(user_id=3e0f04da7bdd4c6f936bf8a1248b32ca)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:06.973032 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a9a62-98a9-4ebd-a1b9-b8e76bff3b3f None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:06.979929 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 188/368] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Sep 24 20:33:06 2022] GET /identity/v3/users/3e0f04da7bdd4c6f936bf8a1248b32ca => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:06.979929 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a9a62-98a9-4ebd-a1b9-b8e76bff3b3f None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:07.000721 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:07.066538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 181/369] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:07.067469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb5cd6-7188-427f-a57e-11be20724814 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:07.115869 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a9a62-98a9-4ebd-a1b9-b8e76bff3b3f None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:07.138889 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:07.171067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e6069-9cad-414d-ab77-8dd46a7e329c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:07.172173 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e6069-9cad-414d-ab77-8dd46a7e329c None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:07.172687 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e6069-9cad-414d-ab77-8dd46a7e329c None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:07.173122 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e6069-9cad-414d-ab77-8dd46a7e329c None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:07.175388 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e6069-9cad-414d-ab77-8dd46a7e329c None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:07.177011 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e6069-9cad-414d-ab77-8dd46a7e329c None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:07.184613 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 189/370] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:33:06 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:07.184613 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e6069-9cad-414d-ab77-8dd46a7e329c None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:07.214950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb5cd6-7188-427f-a57e-11be20724814 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:07.261165 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fac22-e44b-4cc4-98e9-50806c7b45bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:07.261732 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fac22-e44b-4cc4-98e9-50806c7b45bc None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:07.262009 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fac22-e44b-4cc4-98e9-50806c7b45bc None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:07.262282 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fac22-e44b-4cc4-98e9-50806c7b45bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:07.283247 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:07.313661 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e6069-9cad-414d-ab77-8dd46a7e329c None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:07.357340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599004b-e400-4211-94c5-d509defc29f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:07.357340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599004b-e400-4211-94c5-d509defc29f5 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:07.357623 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599004b-e400-4211-94c5-d509defc29f5 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:07.357732 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599004b-e400-4211-94c5-d509defc29f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:07.358434 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599004b-e400-4211-94c5-d509defc29f5 None admin] RBAC: Adding query filter params (role.id=11b3648aadfb4d19b376c5acc9465a44, user.id=3e0f04da7bdd4c6f936bf8a1248b32ca, scope.system=all) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:07.358745 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599004b-e400-4211-94c5-d509defc29f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:07.360233 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599004b-e400-4211-94c5-d509defc29f5 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:07.361667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64fac22-e44b-4cc4-98e9-50806c7b45bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:07.363378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64fac22-e44b-4cc4-98e9-50806c7b45bc None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:07.377840 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 190/371] 10.222.0.61 () {56 vars in 1308 bytes} [Sat Sep 24 20:33:07 2022] GET /identity/v3/role_assignments?user.id=3e0f04da7bdd4c6f936bf8a1248b32ca&scope.system=all&role.id=11b3648aadfb4d19b376c5acc9465a44 => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:07.377840 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599004b-e400-4211-94c5-d509defc29f5 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:07.431948 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:07.499340 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 182/372] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:07.499340 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fac22-e44b-4cc4-98e9-50806c7b45bc None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:07.512300 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599004b-e400-4211-94c5-d509defc29f5 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:07.556964 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:07.564244 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66709d-4e1b-4fe1-b667-eb167f17ffb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:07.566597 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66709d-4e1b-4fe1-b667-eb167f17ffb5 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:07.566885 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66709d-4e1b-4fe1-b667-eb167f17ffb5 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:07.567162 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66709d-4e1b-4fe1-b667-eb167f17ffb5 None admin] PATH_INFO: `/v3/projects/e9733fd590bc408aa51b7edd8cdd8117` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:07.569534 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66709d-4e1b-4fe1-b667-eb167f17ffb5 None admin] RBAC: Authorizing `identity:get_project(project_id=e9733fd590bc408aa51b7edd8cdd8117)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:07.571385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66709d-4e1b-4fe1-b667-eb167f17ffb5 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:07.574207 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 191/373] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:33:07 2022] GET /identity/v3/projects/e9733fd590bc408aa51b7edd8cdd8117 => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:07.576756 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b822f36-dab0-432c-bdbe-2c8cafe686ce None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:07.577041 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b822f36-dab0-432c-bdbe-2c8cafe686ce None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:07.577319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b822f36-dab0-432c-bdbe-2c8cafe686ce None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:07.582966 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 192/374] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:07.583907 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b822f36-dab0-432c-bdbe-2c8cafe686ce None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:07.637887 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fac22-e44b-4cc4-98e9-50806c7b45bc None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:07.687575 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375f4d1-34ae-4bd3-baa9-0f7ea90d97f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:07.688216 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375f4d1-34ae-4bd3-baa9-0f7ea90d97f0 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:07.688526 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375f4d1-34ae-4bd3-baa9-0f7ea90d97f0 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:07.688915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375f4d1-34ae-4bd3-baa9-0f7ea90d97f0 None admin] PATH_INFO: `/v3/groups/8da22d9b508c45438aa1530d1d88a535` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:07.690057 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375f4d1-34ae-4bd3-baa9-0f7ea90d97f0 None admin] RBAC: Authorizing `identity:get_group(group_id=8da22d9b508c45438aa1530d1d88a535)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:07.691575 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375f4d1-34ae-4bd3-baa9-0f7ea90d97f0 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:07.693907 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 183/375] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Sep 24 20:33:07 2022] GET /identity/v3/groups/8da22d9b508c45438aa1530d1d88a535 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:07.694566 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375f4d1-34ae-4bd3-baa9-0f7ea90d97f0 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:07.720992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:07.721170 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b822f36-dab0-432c-bdbe-2c8cafe686ce None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:07.765065 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b20e9-6a71-4f18-a952-ddc85479e2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:07.765632 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b20e9-6a71-4f18-a952-ddc85479e2ee None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:07.765916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b20e9-6a71-4f18-a952-ddc85479e2ee None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:07.766194 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b20e9-6a71-4f18-a952-ddc85479e2ee None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:07.767327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b20e9-6a71-4f18-a952-ddc85479e2ee None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:07.768942 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b20e9-6a71-4f18-a952-ddc85479e2ee None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:07.771074 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 193/376] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:33:07 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:07.771775 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486af391-14f5-4dba-b808-63d4f4d6c446 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:07.772091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486af391-14f5-4dba-b808-63d4f4d6c446 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:07.772389 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486af391-14f5-4dba-b808-63d4f4d6c446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:07.792770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-486af391-14f5-4dba-b808-63d4f4d6c446 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:07.793971 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-486af391-14f5-4dba-b808-63d4f4d6c446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:07.821871 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375f4d1-34ae-4bd3-baa9-0f7ea90d97f0 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:07.861473 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4d4ea-2de3-400b-84ad-4b6cbe574d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:07.861789 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4d4ea-2de3-400b-84ad-4b6cbe574d26 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:07.861992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4d4ea-2de3-400b-84ad-4b6cbe574d26 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:07.862292 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4d4ea-2de3-400b-84ad-4b6cbe574d26 None admin] PATH_INFO: `/v3/groups/53241f43e770473cae3b28ca1f14a00f` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:07.871196 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4d4ea-2de3-400b-84ad-4b6cbe574d26 None admin] RBAC: Authorizing `identity:get_group(group_id=53241f43e770473cae3b28ca1f14a00f)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:07.872503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:07.872615 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4d4ea-2de3-400b-84ad-4b6cbe574d26 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:07.874387 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 184/377] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Sep 24 20:33:07 2022] GET /identity/v3/groups/53241f43e770473cae3b28ca1f14a00f => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:07.874965 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4d4ea-2de3-400b-84ad-4b6cbe574d26 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:07.883754 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 194/378] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:07.885152 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486af391-14f5-4dba-b808-63d4f4d6c446 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:07.995227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:08.006956 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486af391-14f5-4dba-b808-63d4f4d6c446 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:08.022313 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4d4ea-2de3-400b-84ad-4b6cbe574d26 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:08.057296 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97003b-fd26-447b-a7f1-26526e65cc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:08.058202 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97003b-fd26-447b-a7f1-26526e65cc12 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:08.058488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97003b-fd26-447b-a7f1-26526e65cc12 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:08.058770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97003b-fd26-447b-a7f1-26526e65cc12 None admin] PATH_INFO: `/v3/groups/8da22d9b508c45438aa1530d1d88a535` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:08.060650 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97003b-fd26-447b-a7f1-26526e65cc12 None admin] RBAC: Authorizing `identity:get_group(group_id=8da22d9b508c45438aa1530d1d88a535)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:08.062217 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97003b-fd26-447b-a7f1-26526e65cc12 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:08.064405 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 195/379] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Sep 24 20:33:07 2022] GET /identity/v3/groups/8da22d9b508c45438aa1530d1d88a535 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:08.065235 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97003b-fd26-447b-a7f1-26526e65cc12 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:08.067129 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a9481-04ca-495b-aeb7-421fce7fb028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:08.067999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a9481-04ca-495b-aeb7-421fce7fb028 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:08.068569 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a9481-04ca-495b-aeb7-421fce7fb028 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:08.069158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a9481-04ca-495b-aeb7-421fce7fb028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:08.070104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a9481-04ca-495b-aeb7-421fce7fb028 None admin] RBAC: Adding query filter params (group.id=8da22d9b508c45438aa1530d1d88a535, role.id=3481273c76dc4a20b3f73c4f8ea558e6, scope.project.id=aa98305d5a0d465b98d3f7ad7d883522) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:08.070629 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a9481-04ca-495b-aeb7-421fce7fb028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:08.072584 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a9481-04ca-495b-aeb7-421fce7fb028 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:08.080971 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 185/380] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Sep 24 20:33:07 2022] GET /identity/v3/role_assignments?group.id=8da22d9b508c45438aa1530d1d88a535&scope.project.id=aa98305d5a0d465b98d3f7ad7d883522&role.id=3481273c76dc4a20b3f73c4f8ea558e6 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:08.082032 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a9481-04ca-495b-aeb7-421fce7fb028 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:08.153854 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:08.241410 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a9481-04ca-495b-aeb7-421fce7fb028 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:08.266664 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97003b-fd26-447b-a7f1-26526e65cc12 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:08.284574 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bac2c-5a6d-469d-9158-63e9cb8f3f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:08.285407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bac2c-5a6d-469d-9158-63e9cb8f3f56 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:08.285700 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bac2c-5a6d-469d-9158-63e9cb8f3f56 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:08.285984 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bac2c-5a6d-469d-9158-63e9cb8f3f56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:08.286926 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bac2c-5a6d-469d-9158-63e9cb8f3f56 None admin] RBAC: Adding query filter params (group.id=8da22d9b508c45438aa1530d1d88a535, role.id=905829118b764aa9920810cb3b86e0ce, scope.project.id=aa98305d5a0d465b98d3f7ad7d883522) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:08.287250 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bac2c-5a6d-469d-9158-63e9cb8f3f56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:08.289533 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bac2c-5a6d-469d-9158-63e9cb8f3f56 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:08.298271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 186/381] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Sep 24 20:33:08 2022] GET /identity/v3/role_assignments?group.id=8da22d9b508c45438aa1530d1d88a535&scope.project.id=aa98305d5a0d465b98d3f7ad7d883522&role.id=905829118b764aa9920810cb3b86e0ce => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:08.299298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bac2c-5a6d-469d-9158-63e9cb8f3f56 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:08.329822 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:08.334548 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848d640-79e2-4200-a9be-b24e3b3325ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:08.335668 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848d640-79e2-4200-a9be-b24e3b3325ea None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:08.339172 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848d640-79e2-4200-a9be-b24e3b3325ea None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:08.339172 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7848d640-79e2-4200-a9be-b24e3b3325ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:08.340869 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848d640-79e2-4200-a9be-b24e3b3325ea None admin] RBAC: Adding query filter params (group.id=53241f43e770473cae3b28ca1f14a00f, role.id=9cc90aa0ccde4b75b7642101cbf45cf2, scope.project.id=e9733fd590bc408aa51b7edd8cdd8117) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:08.341192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848d640-79e2-4200-a9be-b24e3b3325ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:08.342719 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7848d640-79e2-4200-a9be-b24e3b3325ea None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:08.357404 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 196/382] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Sep 24 20:33:08 2022] GET /identity/v3/role_assignments?group.id=53241f43e770473cae3b28ca1f14a00f&scope.project.id=e9733fd590bc408aa51b7edd8cdd8117&role.id=9cc90aa0ccde4b75b7642101cbf45cf2 => generated 260 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:08.467150 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bac2c-5a6d-469d-9158-63e9cb8f3f56 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:08.508214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f292c-a417-4337-b743-6a06d346196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:08.508922 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f292c-a417-4337-b743-6a06d346196a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:08.509205 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f292c-a417-4337-b743-6a06d346196a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:08.510019 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f292c-a417-4337-b743-6a06d346196a None admin] PATH_INFO: `/v3/roles/member` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:08.522792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f292c-a417-4337-b743-6a06d346196a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:08.528404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-a20f292c-a417-4337-b743-6a06d346196a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:33:08.528404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:08.528404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:08.528404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:08.528404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:08.528404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:08.528404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:08.528404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:08.528404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:08.528404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:08.528404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:08.528404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:08.528404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:08.528404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:08.528404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:08.528404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:08.529380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:08.529380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:08.529380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:08.529380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:08.529380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:08.529380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:08.529380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:08.529380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:08.529380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:08.529380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:08.529380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:08.529380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:08.529380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:08.529380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:08.529380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:08.529380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:08.531861 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:08.531861 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:08.531861 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:08.531861 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:08.531861 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:08.531861 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:08.531861 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:08.531861 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:08.531861 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:08.531861 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:08.531861 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:33:08.531861 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:08.531861 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 187/383] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:08.535757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848d640-79e2-4200-a9be-b24e3b3325ea None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:08.646429 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7848d640-79e2-4200-a9be-b24e3b3325ea None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:08.676437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:08.686361 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022292a0-4992-4dd8-abc6-ab7ae4eaa342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:08.686987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022292a0-4992-4dd8-abc6-ab7ae4eaa342 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:08.687335 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022292a0-4992-4dd8-abc6-ab7ae4eaa342 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:08.687615 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022292a0-4992-4dd8-abc6-ab7ae4eaa342 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:08.688285 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022292a0-4992-4dd8-abc6-ab7ae4eaa342 None admin] RBAC: Adding query filter params (name=member) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:08.688634 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022292a0-4992-4dd8-abc6-ab7ae4eaa342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:08.690009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022292a0-4992-4dd8-abc6-ab7ae4eaa342 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:08.704260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 197/384] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:33:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:08.705686 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f292c-a417-4337-b743-6a06d346196a None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:08.780940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:08.814510 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f292c-a417-4337-b743-6a06d346196a None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:08.849298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a693c-2442-4792-a86e-86276266d756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:08.849976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a693c-2442-4792-a86e-86276266d756 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:08.850260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a693c-2442-4792-a86e-86276266d756 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:08.850539 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a693c-2442-4792-a86e-86276266d756 None admin] PATH_INFO: `/v3/groups/8da22d9b508c45438aa1530d1d88a535` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:08.851706 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a693c-2442-4792-a86e-86276266d756 None admin] RBAC: Authorizing `identity:get_group(group_id=8da22d9b508c45438aa1530d1d88a535)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:08.853418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a693c-2442-4792-a86e-86276266d756 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:08.859633 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 188/385] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Sep 24 20:33:08 2022] GET /identity/v3/groups/8da22d9b508c45438aa1530d1d88a535 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:08.861071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022292a0-4992-4dd8-abc6-ab7ae4eaa342 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:08.971636 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022292a0-4992-4dd8-abc6-ab7ae4eaa342 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:09.008977 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cb19e-84db-4ec9-9095-86e1f48b0e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:09.009888 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cb19e-84db-4ec9-9095-86e1f48b0e83 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:09.010175 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cb19e-84db-4ec9-9095-86e1f48b0e83 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:09.010454 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cb19e-84db-4ec9-9095-86e1f48b0e83 None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:09.011642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cb19e-84db-4ec9-9095-86e1f48b0e83 None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:09.013118 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cb19e-84db-4ec9-9095-86e1f48b0e83 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:09.019688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 198/386] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:33:08 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:09.021062 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a693c-2442-4792-a86e-86276266d756 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:09.130646 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a693c-2442-4792-a86e-86276266d756 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:09.165329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4c1b6-c5c0-419d-bbe0-77e23b68f420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:09.166516 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4c1b6-c5c0-419d-bbe0-77e23b68f420 None admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:09.167055 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4c1b6-c5c0-419d-bbe0-77e23b68f420 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:09.167329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4c1b6-c5c0-419d-bbe0-77e23b68f420 None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa/groups/8da22d9b508c45438aa1530d1d88a535/roles/3481273c76dc4a20b3f73c4f8ea558e6` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:09.169268 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4c1b6-c5c0-419d-bbe0-77e23b68f420 None admin] RBAC: Authorizing `identity:create_grant(project_id=0acc8c7eebf94a958818fae44bb2a0aa, group_id=8da22d9b508c45438aa1530d1d88a535, role_id=3481273c76dc4a20b3f73c4f8ea558e6)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:09.170714 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4c1b6-c5c0-419d-bbe0-77e23b68f420 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:09.184677 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:09.189898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 189/387] 10.222.0.61 () {58 vars in 1442 bytes} [Sat Sep 24 20:33:09 2022] PUT /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa/groups/8da22d9b508c45438aa1530d1d88a535/roles/3481273c76dc4a20b3f73c4f8ea558e6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:33:09.529204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af0c3c-f75a-4045-9606-89d181779510 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:09.529597 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af0c3c-f75a-4045-9606-89d181779510 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:09.529784 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af0c3c-f75a-4045-9606-89d181779510 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:09.531347 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 199/388] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:09.536525 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d20fc-1c31-4bdc-8e04-287bfccabb11 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:09.536975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d20fc-1c31-4bdc-8e04-287bfccabb11 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:09.537142 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d20fc-1c31-4bdc-8e04-287bfccabb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:09.556862 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-8c5d20fc-1c31-4bdc-8e04-287bfccabb11 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:09.558068 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-8c5d20fc-1c31-4bdc-8e04-287bfccabb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:09.633550 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 190/389] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:10.190675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af0c3c-f75a-4045-9606-89d181779510 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:10.262122 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:10.313982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af0c3c-f75a-4045-9606-89d181779510 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:10.362357 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2bae7-4c3e-44b5-8113-c5012b3bef6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:10.362988 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2bae7-4c3e-44b5-8113-c5012b3bef6f None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:10.363269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2bae7-4c3e-44b5-8113-c5012b3bef6f None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:10.363547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2bae7-4c3e-44b5-8113-c5012b3bef6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:10.381170 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2bae7-4c3e-44b5-8113-c5012b3bef6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:10.387266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-4ba2bae7-4c3e-44b5-8113-c5012b3bef6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:33:10.387266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:10.387266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:10.387266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:10.387266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:10.387266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:10.387266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:10.387266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:10.387266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:10.387266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:10.387266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:10.387266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:10.387266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:10.387266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:10.387266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:10.387266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:10.388142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:10.388142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:10.388142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:10.388142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:10.388142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:10.388142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:10.388142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:10.388142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:10.388142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:10.388142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:10.388142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:10.388142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:10.388142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:10.388142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:10.388142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:10.388142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:10.388971 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:10.388971 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:10.388971 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:10.388971 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:10.388971 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:10.388971 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:10.388971 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:10.388971 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:10.388971 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:10.388971 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:10.388971 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:33:10.388971 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:10.392817 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 200/390] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:33:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:10.399545 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d20fc-1c31-4bdc-8e04-287bfccabb11 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:10.541184 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d20fc-1c31-4bdc-8e04-287bfccabb11 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:10.579162 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:10.590255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733a427-6521-40d4-975e-121ce2f2a092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:10.590893 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733a427-6521-40d4-975e-121ce2f2a092 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:10.591176 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733a427-6521-40d4-975e-121ce2f2a092 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:10.591451 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733a427-6521-40d4-975e-121ce2f2a092 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:10.592127 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733a427-6521-40d4-975e-121ce2f2a092 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:10.592479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733a427-6521-40d4-975e-121ce2f2a092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:10.593949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733a427-6521-40d4-975e-121ce2f2a092 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:10.608621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 191/391] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:10.613942 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2bae7-4c3e-44b5-8113-c5012b3bef6f None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:10.729477 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2bae7-4c3e-44b5-8113-c5012b3bef6f None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:10.750999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:10.766716 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5879fd-dbd6-4777-8483-b1c06e7e5ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:10.767357 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5879fd-dbd6-4777-8483-b1c06e7e5ff9 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:10.767700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5879fd-dbd6-4777-8483-b1c06e7e5ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:10.767958 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5879fd-dbd6-4777-8483-b1c06e7e5ff9 None admin] PATH_INFO: `/v3/groups/8da22d9b508c45438aa1530d1d88a535` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:10.769167 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5879fd-dbd6-4777-8483-b1c06e7e5ff9 None admin] RBAC: Authorizing `identity:get_group(group_id=8da22d9b508c45438aa1530d1d88a535)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:10.770607 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5879fd-dbd6-4777-8483-b1c06e7e5ff9 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:10.772685 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 201/392] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Sep 24 20:33:10 2022] GET /identity/v3/groups/8da22d9b508c45438aa1530d1d88a535 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:10.778897 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733a427-6521-40d4-975e-121ce2f2a092 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:10.917393 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733a427-6521-40d4-975e-121ce2f2a092 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:10.965810 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1082be4-21d6-4ef9-9434-d7d07cc590ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:10.966457 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1082be4-21d6-4ef9-9434-d7d07cc590ca None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:10.966740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1082be4-21d6-4ef9-9434-d7d07cc590ca None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:10.967017 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1082be4-21d6-4ef9-9434-d7d07cc590ca None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:10.968165 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1082be4-21d6-4ef9-9434-d7d07cc590ca None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:10.969680 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1082be4-21d6-4ef9-9434-d7d07cc590ca None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:10.971715 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 192/393] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:33:10 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:10.977162 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5879fd-dbd6-4777-8483-b1c06e7e5ff9 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:11.143631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5879fd-dbd6-4777-8483-b1c06e7e5ff9 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:11.186966 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf3469-aeb0-4692-81b4-010df6b605ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:11.187643 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf3469-aeb0-4692-81b4-010df6b605ca None admin] REQUEST_METHOD: `PUT` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:11.187931 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf3469-aeb0-4692-81b4-010df6b605ca None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:11.188211 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf3469-aeb0-4692-81b4-010df6b605ca None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa/groups/8da22d9b508c45438aa1530d1d88a535/roles/905829118b764aa9920810cb3b86e0ce` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:11.191795 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf3469-aeb0-4692-81b4-010df6b605ca None admin] RBAC: Authorizing `identity:create_grant(project_id=0acc8c7eebf94a958818fae44bb2a0aa, group_id=8da22d9b508c45438aa1530d1d88a535, role_id=905829118b764aa9920810cb3b86e0ce)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:11.193268 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf3469-aeb0-4692-81b4-010df6b605ca None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:11.213848 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 202/394] 10.222.0.61 () {58 vars in 1442 bytes} [Sat Sep 24 20:33:10 2022] PUT /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa/groups/8da22d9b508c45438aa1530d1d88a535/roles/905829118b764aa9920810cb3b86e0ce => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:33:11.297312 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d4795-e471-41e0-bc40-0e031736926b None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:11.297965 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d4795-e471-41e0-bc40-0e031736926b None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:11.298428 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d4795-e471-41e0-bc40-0e031736926b None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:11.300180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 193/395] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:11.305557 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9acc3-01d4-4746-8431-51163fad1534 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:11.305844 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9acc3-01d4-4746-8431-51163fad1534 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:11.306635 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9acc3-01d4-4746-8431-51163fad1534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:11.332229 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-a6e9acc3-01d4-4746-8431-51163fad1534 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:11.333506 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-a6e9acc3-01d4-4746-8431-51163fad1534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:11.396389 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:11.433481 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 203/396] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:11.552886 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69449c-0ea6-44a4-9c49-f13b60b2835e None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:11.553421 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69449c-0ea6-44a4-9c49-f13b60b2835e None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:11.553421 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69449c-0ea6-44a4-9c49-f13b60b2835e None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:11.555089 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 194/397] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:11.560258 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212e98a-5d59-438a-9d6e-0147dae837da None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:11.560593 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212e98a-5d59-438a-9d6e-0147dae837da None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:11.560875 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212e98a-5d59-438a-9d6e-0147dae837da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:11.585240 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-0212e98a-5d59-438a-9d6e-0147dae837da None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:11.586428 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-0212e98a-5d59-438a-9d6e-0147dae837da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:11.678757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 204/398] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:11.687406 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f1e99-081f-429b-9364-9cc98e0d6cba None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:11.687618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f1e99-081f-429b-9364-9cc98e0d6cba None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:11.687897 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f1e99-081f-429b-9364-9cc98e0d6cba None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:11.689513 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 195/399] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:11.694756 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991b02d-40b0-4dd6-be7e-ab412d657ad3 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:11.695050 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991b02d-40b0-4dd6-be7e-ab412d657ad3 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:11.695333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991b02d-40b0-4dd6-be7e-ab412d657ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:11.714473 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-3991b02d-40b0-4dd6-be7e-ab412d657ad3 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:11.715675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-3991b02d-40b0-4dd6-be7e-ab412d657ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:11.788407 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 205/400] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:11.897489 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f1e99-081f-429b-9364-9cc98e0d6cba None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:11.964611 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:12.018750 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f1e99-081f-429b-9364-9cc98e0d6cba None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:12.066575 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebb074-046c-4225-b92d-503e15eac6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:12.067207 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebb074-046c-4225-b92d-503e15eac6eb None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:12.067493 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebb074-046c-4225-b92d-503e15eac6eb None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:12.067773 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebb074-046c-4225-b92d-503e15eac6eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:12.079434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebb074-046c-4225-b92d-503e15eac6eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:12.084953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-acebb074-046c-4225-b92d-503e15eac6eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:33:12.084953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:12.084953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:12.084953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:12.084953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:12.084953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:12.084953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:12.084953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:12.084953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:12.084953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:12.084953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:12.084953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:12.084953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:12.084953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:12.084953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:12.084953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:12.085792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:12.085792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:12.085792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:12.085792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:12.085792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:12.085792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:12.085792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:12.085792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:12.085792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:12.085792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:12.085792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:12.085792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:12.085792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:12.085792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:12.085792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:12.085792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:12.086685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:12.086685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:12.086685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:12.086685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:12.086685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:12.086685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:12.086685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:12.086685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:12.086685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:12.086685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:12.086685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:33:12.086685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:12.086685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 196/401] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:33:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:12.092742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991b02d-40b0-4dd6-be7e-ab412d657ad3 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:12.155505 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebb074-046c-4225-b92d-503e15eac6eb None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:12.183507 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:12.282831 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991b02d-40b0-4dd6-be7e-ab412d657ad3 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:12.290598 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebb074-046c-4225-b92d-503e15eac6eb None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:12.315062 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:12.319370 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c84adf-f86e-445c-ba1e-e55aecefbf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:12.319983 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c84adf-f86e-445c-ba1e-e55aecefbf55 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:12.320251 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c84adf-f86e-445c-ba1e-e55aecefbf55 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:12.320586 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c84adf-f86e-445c-ba1e-e55aecefbf55 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:12.321212 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c84adf-f86e-445c-ba1e-e55aecefbf55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:12.321511 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c84adf-f86e-445c-ba1e-e55aecefbf55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:12.323622 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c84adf-f86e-445c-ba1e-e55aecefbf55 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:12.333907 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6408b5-5d7a-4d6f-bf57-d0748926ce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:12.334538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6408b5-5d7a-4d6f-bf57-d0748926ce4b None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:12.334819 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6408b5-5d7a-4d6f-bf57-d0748926ce4b None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:12.335094 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6408b5-5d7a-4d6f-bf57-d0748926ce4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:12.337019 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 206/402] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:12.338589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c84adf-f86e-445c-ba1e-e55aecefbf55 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:12.346122 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6408b5-5d7a-4d6f-bf57-d0748926ce4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:12.352298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-0e6408b5-5d7a-4d6f-bf57-d0748926ce4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:33:12.352298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:12.352298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:12.352298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:12.352298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:12.352298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:12.352298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:12.352298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:12.352298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:12.352298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:12.352298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:12.352298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:12.352298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:12.352298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:12.352298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:12.352298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:12.356459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:12.356459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:12.356459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:12.356459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:12.356459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:12.356459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:12.356459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:12.356459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:12.356459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:12.356459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:12.356459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:12.356459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:12.356459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:12.356459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:12.356459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:12.356459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:12.357265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:12.357265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:12.357265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:12.357265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:12.357265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:12.357265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:12.357265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:12.357265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:12.357265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:12.357265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:12.357265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:33:12.357265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:12.357265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 197/403] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:33:12.357265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154647c4-05b5-4bf4-822b-8c3d193ea8e8 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:12.357977 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154647c4-05b5-4bf4-822b-8c3d193ea8e8 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:12.357977 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154647c4-05b5-4bf4-822b-8c3d193ea8e8 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:12.360718 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 198/404] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:12.361514 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154647c4-05b5-4bf4-822b-8c3d193ea8e8 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:12.453782 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:12.456735 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c84adf-f86e-445c-ba1e-e55aecefbf55 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:12.476949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154647c4-05b5-4bf4-822b-8c3d193ea8e8 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:12.500712 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd126b3-2c2a-4641-b735-f86d8cac03c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:12.501341 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd126b3-2c2a-4641-b735-f86d8cac03c0 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:12.501621 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd126b3-2c2a-4641-b735-f86d8cac03c0 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:12.501894 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd126b3-2c2a-4641-b735-f86d8cac03c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:12.512766 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd126b3-2c2a-4641-b735-f86d8cac03c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:12.517917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-ecd126b3-2c2a-4641-b735-f86d8cac03c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:33:12.517917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:12.517917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:12.517917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:12.517917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:12.517917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:12.517917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:12.517917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:12.517917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:12.517917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:12.517917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:12.517917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:12.517917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:12.517917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:12.517917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:12.517917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:12.518786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:12.518786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:12.518786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:12.518786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:12.518786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:12.518786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:12.518786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:12.518786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:12.518786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:12.518786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:12.518786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:12.518786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:12.518786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:12.518786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:12.518786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:12.518786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:12.519603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:12.519603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:12.519603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:12.519603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:12.519603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:12.519603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:12.519603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:12.519603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:12.519603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:12.519603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:12.519603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:33:12.519603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:12.519603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 207/405] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:33:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:12.520276 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd126b3-2c2a-4641-b735-f86d8cac03c0 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:12.524953 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6fe12-07ec-467c-a1fb-c9ac1bb63484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:12.525549 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6fe12-07ec-467c-a1fb-c9ac1bb63484 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:12.525830 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6fe12-07ec-467c-a1fb-c9ac1bb63484 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:12.526112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6fe12-07ec-467c-a1fb-c9ac1bb63484 None admin] PATH_INFO: `/v3/groups/53241f43e770473cae3b28ca1f14a00f` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:12.527199 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6fe12-07ec-467c-a1fb-c9ac1bb63484 None admin] RBAC: Authorizing `identity:get_group(group_id=53241f43e770473cae3b28ca1f14a00f)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:12.528662 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6fe12-07ec-467c-a1fb-c9ac1bb63484 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:12.534532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 199/406] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Sep 24 20:33:12 2022] GET /identity/v3/groups/53241f43e770473cae3b28ca1f14a00f => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:12.534532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb66821-149a-4451-ae8c-941afb6d5ac8 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:12.534532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb66821-149a-4451-ae8c-941afb6d5ac8 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:12.534532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb66821-149a-4451-ae8c-941afb6d5ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:12.551409 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-ecb66821-149a-4451-ae8c-941afb6d5ac8 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:12.552617 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-ecb66821-149a-4451-ae8c-941afb6d5ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:12.602468 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:12.629319 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 200/407] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:12.630165 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb66821-149a-4451-ae8c-941afb6d5ac8 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:12.638266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd126b3-2c2a-4641-b735-f86d8cac03c0 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:12.686223 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47a316-a212-4e7c-877d-759f82a7a8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:12.687270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47a316-a212-4e7c-877d-759f82a7a8ea None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:12.687758 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47a316-a212-4e7c-877d-759f82a7a8ea None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:12.688735 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47a316-a212-4e7c-877d-759f82a7a8ea None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:12.689537 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47a316-a212-4e7c-877d-759f82a7a8ea None admin] RBAC: Adding query filter params (name=member) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:12.689852 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47a316-a212-4e7c-877d-759f82a7a8ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:12.691224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47a316-a212-4e7c-877d-759f82a7a8ea None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:12.704713 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 208/408] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:33:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:12.705585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47a316-a212-4e7c-877d-759f82a7a8ea None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:12.732679 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:12.753735 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb66821-149a-4451-ae8c-941afb6d5ac8 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:12.794038 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea11b07-513a-4f6b-b63a-99e87cec1912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:12.794428 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea11b07-513a-4f6b-b63a-99e87cec1912 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:12.794714 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea11b07-513a-4f6b-b63a-99e87cec1912 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:12.794985 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea11b07-513a-4f6b-b63a-99e87cec1912 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:12.795642 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea11b07-513a-4f6b-b63a-99e87cec1912 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:12.795946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea11b07-513a-4f6b-b63a-99e87cec1912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:12.797369 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea11b07-513a-4f6b-b63a-99e87cec1912 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:12.806155 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 201/409] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:12.806859 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea11b07-513a-4f6b-b63a-99e87cec1912 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:12.834874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47a316-a212-4e7c-877d-759f82a7a8ea None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:12.849645 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:12.885265 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d276a7-9d42-4b8a-87a8-f344bdfdb4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:12.886247 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d276a7-9d42-4b8a-87a8-f344bdfdb4d2 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:12.886759 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d276a7-9d42-4b8a-87a8-f344bdfdb4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:12.887251 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d276a7-9d42-4b8a-87a8-f344bdfdb4d2 None admin] PATH_INFO: `/v3/projects/e9733fd590bc408aa51b7edd8cdd8117` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:12.889135 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d276a7-9d42-4b8a-87a8-f344bdfdb4d2 None admin] RBAC: Authorizing `identity:get_project(project_id=e9733fd590bc408aa51b7edd8cdd8117)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:12.891280 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d276a7-9d42-4b8a-87a8-f344bdfdb4d2 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:12.894360 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 209/410] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:33:12 2022] GET /identity/v3/projects/e9733fd590bc408aa51b7edd8cdd8117 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:12.895320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d276a7-9d42-4b8a-87a8-f344bdfdb4d2 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:12.920293 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea11b07-513a-4f6b-b63a-99e87cec1912 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:12.957834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce1b0d-d798-47d1-b6d0-0b0d4a712064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:12.959136 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce1b0d-d798-47d1-b6d0-0b0d4a712064 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:12.959694 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce1b0d-d798-47d1-b6d0-0b0d4a712064 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:12.959980 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce1b0d-d798-47d1-b6d0-0b0d4a712064 None admin] PATH_INFO: `/v3/groups/8da22d9b508c45438aa1530d1d88a535` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:12.961194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce1b0d-d798-47d1-b6d0-0b0d4a712064 None admin] RBAC: Authorizing `identity:get_group(group_id=8da22d9b508c45438aa1530d1d88a535)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:12.962785 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce1b0d-d798-47d1-b6d0-0b0d4a712064 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:12.964609 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 202/411] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Sep 24 20:33:12 2022] GET /identity/v3/groups/8da22d9b508c45438aa1530d1d88a535 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:12.965195 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce1b0d-d798-47d1-b6d0-0b0d4a712064 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:13.007904 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:13.019747 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d276a7-9d42-4b8a-87a8-f344bdfdb4d2 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:13.059310 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb094d-ec2c-4ef9-a4b2-cf55b3dffb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:13.059974 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb094d-ec2c-4ef9-a4b2-cf55b3dffb67 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:13.060254 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb094d-ec2c-4ef9-a4b2-cf55b3dffb67 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:13.060672 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb094d-ec2c-4ef9-a4b2-cf55b3dffb67 None admin] PATH_INFO: `/v3/groups/8da22d9b508c45438aa1530d1d88a535` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:13.061802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb094d-ec2c-4ef9-a4b2-cf55b3dffb67 None admin] RBAC: Authorizing `identity:get_group(group_id=8da22d9b508c45438aa1530d1d88a535)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:13.063248 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb094d-ec2c-4ef9-a4b2-cf55b3dffb67 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:13.064959 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 210/412] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Sep 24 20:33:12 2022] GET /identity/v3/groups/8da22d9b508c45438aa1530d1d88a535 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:13.069636 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb094d-ec2c-4ef9-a4b2-cf55b3dffb67 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:13.079682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce1b0d-d798-47d1-b6d0-0b0d4a712064 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:13.086982 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:13.117262 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3d228-13ee-4150-a48b-4591c4b7803c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:13.117930 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3d228-13ee-4150-a48b-4591c4b7803c None admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:13.118383 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3d228-13ee-4150-a48b-4591c4b7803c None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:13.118716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3d228-13ee-4150-a48b-4591c4b7803c None admin] PATH_INFO: `/v3/projects/e9733fd590bc408aa51b7edd8cdd8117/groups/53241f43e770473cae3b28ca1f14a00f/roles/9cc90aa0ccde4b75b7642101cbf45cf2` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:13.120854 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3d228-13ee-4150-a48b-4591c4b7803c None admin] RBAC: Authorizing `identity:create_grant(project_id=e9733fd590bc408aa51b7edd8cdd8117, group_id=53241f43e770473cae3b28ca1f14a00f, role_id=9cc90aa0ccde4b75b7642101cbf45cf2)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:13.122385 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3d228-13ee-4150-a48b-4591c4b7803c None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:13.137495 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 203/413] 10.222.0.61 () {58 vars in 1442 bytes} [Sat Sep 24 20:33:12 2022] PUT /identity/v3/projects/e9733fd590bc408aa51b7edd8cdd8117/groups/53241f43e770473cae3b28ca1f14a00f/roles/9cc90aa0ccde4b75b7642101cbf45cf2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:33:13.146507 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3d228-13ee-4150-a48b-4591c4b7803c None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:13.182548 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb094d-ec2c-4ef9-a4b2-cf55b3dffb67 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:13.231767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb2dd9-7697-4e2d-bad0-26a0b2dea4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:13.232800 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb2dd9-7697-4e2d-bad0-26a0b2dea4c4 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:13.233291 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb2dd9-7697-4e2d-bad0-26a0b2dea4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:13.233802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb2dd9-7697-4e2d-bad0-26a0b2dea4c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:13.247112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb2dd9-7697-4e2d-bad0-26a0b2dea4c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:13.253914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-b4eb2dd9-7697-4e2d-bad0-26a0b2dea4c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:33:13.253914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:13.253914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:13.253914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:13.253914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:13.253914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:13.253914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:13.253914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:13.253914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:13.253914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:13.253914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:13.253914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:13.253914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:13.253914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:13.253914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:13.253914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:13.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:13.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:13.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:13.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:13.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:13.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:13.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:13.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:13.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:13.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:13.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:13.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:13.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:13.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:13.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:13.254896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:13.255685 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:13.255685 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:13.255685 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:13.255685 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:13.255685 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:13.255685 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:13.255685 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:13.255685 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:13.255685 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:13.255685 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:13.255685 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:33:13.255685 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:13.258548 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 211/414] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:13.259753 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb2dd9-7697-4e2d-bad0-26a0b2dea4c4 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:13.282424 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:13.300045 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3d228-13ee-4150-a48b-4591c4b7803c None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:13.353606 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ab88b-9c00-4fa4-bc85-965974c1a917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:13.354165 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ab88b-9c00-4fa4-bc85-965974c1a917 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:13.354442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ab88b-9c00-4fa4-bc85-965974c1a917 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:13.354708 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ab88b-9c00-4fa4-bc85-965974c1a917 None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:13.356265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ab88b-9c00-4fa4-bc85-965974c1a917 None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:13.358029 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ab88b-9c00-4fa4-bc85-965974c1a917 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:13.360126 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 204/415] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:33:13 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:13.360846 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ab88b-9c00-4fa4-bc85-965974c1a917 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:13.382716 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb2dd9-7697-4e2d-bad0-26a0b2dea4c4 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:13.402531 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:13.433946 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdc8e5-107d-417e-9986-4da2c0b7b80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:13.435145 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdc8e5-107d-417e-9986-4da2c0b7b80a None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:13.435432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdc8e5-107d-417e-9986-4da2c0b7b80a None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:13.435994 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdc8e5-107d-417e-9986-4da2c0b7b80a None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:13.437929 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdc8e5-107d-417e-9986-4da2c0b7b80a None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:13.442709 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdc8e5-107d-417e-9986-4da2c0b7b80a None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:13.447959 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 212/416] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:33:13 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:13.449116 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdc8e5-107d-417e-9986-4da2c0b7b80a None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:13.491096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ab88b-9c00-4fa4-bc85-965974c1a917 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:13.546932 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e191f0d-b982-464f-b8a1-9198837146fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:13.547961 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e191f0d-b982-464f-b8a1-9198837146fa None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:13.548820 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e191f0d-b982-464f-b8a1-9198837146fa None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:13.549105 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e191f0d-b982-464f-b8a1-9198837146fa None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:13.549778 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e191f0d-b982-464f-b8a1-9198837146fa None admin] RBAC: Adding query filter params (name=member) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:13.550117 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e191f0d-b982-464f-b8a1-9198837146fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:13.552214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e191f0d-b982-464f-b8a1-9198837146fa None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:13.555151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:13.572589 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 205/417] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:33:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:13.573354 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e191f0d-b982-464f-b8a1-9198837146fa None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:13.578704 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdc8e5-107d-417e-9986-4da2c0b7b80a None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:13.626421 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad006f56-c0b9-4ff6-a7b0-0c37a9c6aa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:13.627408 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad006f56-c0b9-4ff6-a7b0-0c37a9c6aa71 None admin] REQUEST_METHOD: `PUT` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:13.627890 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad006f56-c0b9-4ff6-a7b0-0c37a9c6aa71 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:13.628410 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad006f56-c0b9-4ff6-a7b0-0c37a9c6aa71 None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522/groups/8da22d9b508c45438aa1530d1d88a535/roles/3481273c76dc4a20b3f73c4f8ea558e6` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:13.631834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad006f56-c0b9-4ff6-a7b0-0c37a9c6aa71 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa98305d5a0d465b98d3f7ad7d883522, group_id=8da22d9b508c45438aa1530d1d88a535, role_id=3481273c76dc4a20b3f73c4f8ea558e6)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:13.634798 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad006f56-c0b9-4ff6-a7b0-0c37a9c6aa71 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:13.654162 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 213/418] 10.222.0.61 () {58 vars in 1442 bytes} [Sat Sep 24 20:33:13 2022] PUT /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522/groups/8da22d9b508c45438aa1530d1d88a535/roles/3481273c76dc4a20b3f73c4f8ea558e6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:33:13.655433 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad006f56-c0b9-4ff6-a7b0-0c37a9c6aa71 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:13.709024 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:13.717749 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e191f0d-b982-464f-b8a1-9198837146fa None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:13.767136 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ace82-a6e4-435d-b060-5df15d996a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:13.768273 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ace82-a6e4-435d-b060-5df15d996a6b None admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:13.768846 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ace82-a6e4-435d-b060-5df15d996a6b None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:13.769374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ace82-a6e4-435d-b060-5df15d996a6b None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522/groups/8da22d9b508c45438aa1530d1d88a535/roles/905829118b764aa9920810cb3b86e0ce` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:13.772042 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ace82-a6e4-435d-b060-5df15d996a6b None admin] RBAC: Authorizing `identity:create_grant(project_id=aa98305d5a0d465b98d3f7ad7d883522, group_id=8da22d9b508c45438aa1530d1d88a535, role_id=905829118b764aa9920810cb3b86e0ce)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:13.774057 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ace82-a6e4-435d-b060-5df15d996a6b None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:13.794942 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 206/419] 10.222.0.61 () {58 vars in 1442 bytes} [Sat Sep 24 20:33:13 2022] PUT /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522/groups/8da22d9b508c45438aa1530d1d88a535/roles/905829118b764aa9920810cb3b86e0ce => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:33:13.872020 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad006f56-c0b9-4ff6-a7b0-0c37a9c6aa71 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:13.922735 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f5933-9737-4ce1-8b88-34384a53454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:13.923352 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f5933-9737-4ce1-8b88-34384a53454b None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:13.923630 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f5933-9737-4ce1-8b88-34384a53454b None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:13.923903 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f5933-9737-4ce1-8b88-34384a53454b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:13.939074 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ad074-7b7b-42db-a603-3176d411fb52 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:13.939386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ad074-7b7b-42db-a603-3176d411fb52 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:13.939633 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ad074-7b7b-42db-a603-3176d411fb52 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:13.941310 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 207/420] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:33:13.944172 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:13.947222 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e0310-e752-48c2-a4ea-89188c83077d None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:13.947722 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e0310-e752-48c2-a4ea-89188c83077d None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:13.948049 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e0310-e752-48c2-a4ea-89188c83077d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:13.972373 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-c61e0310-e752-48c2-a4ea-89188c83077d None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:13.973632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-c61e0310-e752-48c2-a4ea-89188c83077d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:14.014922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f5933-9737-4ce1-8b88-34384a53454b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:14.016430 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f5933-9737-4ce1-8b88-34384a53454b None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:14.089757 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 208/421] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:33:14.173728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 214/422] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:14.179116 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e0310-e752-48c2-a4ea-89188c83077d None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:14.279853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:14.299695 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e0310-e752-48c2-a4ea-89188c83077d None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:14.347810 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff937bd-aad7-4f8d-a87b-692dae7b8da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:14.348535 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff937bd-aad7-4f8d-a87b-692dae7b8da3 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:14.348819 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff937bd-aad7-4f8d-a87b-692dae7b8da3 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:14.349101 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff937bd-aad7-4f8d-a87b-692dae7b8da3 None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:14.350283 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff937bd-aad7-4f8d-a87b-692dae7b8da3 None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:14.351721 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff937bd-aad7-4f8d-a87b-692dae7b8da3 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:14.353425 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 209/423] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:33:14 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:14.359004 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f5933-9737-4ce1-8b88-34384a53454b None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:14.425171 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:14.477613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff937bd-aad7-4f8d-a87b-692dae7b8da3 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:14.501359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f5933-9737-4ce1-8b88-34384a53454b None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:14.562772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756bfc2-ca17-4a78-969a-a4ab7855c512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:14.563403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756bfc2-ca17-4a78-969a-a4ab7855c512 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:14.563682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756bfc2-ca17-4a78-969a-a4ab7855c512 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:14.563955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756bfc2-ca17-4a78-969a-a4ab7855c512 None admin] PATH_INFO: `/v3/groups/8da22d9b508c45438aa1530d1d88a535` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:14.565300 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756bfc2-ca17-4a78-969a-a4ab7855c512 None admin] RBAC: Authorizing `identity:get_group(group_id=8da22d9b508c45438aa1530d1d88a535)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:14.566731 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756bfc2-ca17-4a78-969a-a4ab7855c512 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:14.576941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 215/424] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Sep 24 20:33:14 2022] GET /identity/v3/groups/8da22d9b508c45438aa1530d1d88a535 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:14.582566 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756bfc2-ca17-4a78-969a-a4ab7855c512 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:14.649019 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff937bd-aad7-4f8d-a87b-692dae7b8da3 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:14.716301 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c547aa-6e67-43eb-b4f8-68826ea667cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:14.717725 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c547aa-6e67-43eb-b4f8-68826ea667cd None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:14.718204 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c547aa-6e67-43eb-b4f8-68826ea667cd None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:14.718690 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c547aa-6e67-43eb-b4f8-68826ea667cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:14.739135 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756bfc2-ca17-4a78-969a-a4ab7855c512 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:14.741713 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c547aa-6e67-43eb-b4f8-68826ea667cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:14.747317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-96c547aa-6e67-43eb-b4f8-68826ea667cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:33:14.747317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:14.747317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:14.747317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:14.747317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:14.747317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:14.747317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:14.747317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:14.747317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:14.747317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:14.747317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:14.747317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:14.747317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:14.747317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:14.747317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:14.747317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:14.748214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:14.748214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:14.748214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:14.748214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:14.748214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:14.748214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:14.748214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:14.748214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:14.748214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:14.748214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:14.748214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:14.748214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:14.748214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:14.748214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:14.748214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:14.748214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:14.749027 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:14.749027 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:14.749027 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:14.749027 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:14.749027 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:14.749027 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:14.749027 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:14.749027 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:14.749027 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:14.749027 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:14.749027 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:33:14.749027 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:14.757948 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 210/425] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:33:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:14.763631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c547aa-6e67-43eb-b4f8-68826ea667cd None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:14.772800 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:14.788737 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:14.801204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92e528-b00e-40ba-9201-9cdc861ea9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:14.802176 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92e528-b00e-40ba-9201-9cdc861ea9df None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:14.802725 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92e528-b00e-40ba-9201-9cdc861ea9df None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:14.803212 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92e528-b00e-40ba-9201-9cdc861ea9df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:14.804129 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92e528-b00e-40ba-9201-9cdc861ea9df None admin] RBAC: Adding query filter params (group.id=8da22d9b508c45438aa1530d1d88a535, role.id=3481273c76dc4a20b3f73c4f8ea558e6, scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:14.804703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92e528-b00e-40ba-9201-9cdc861ea9df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:14.806874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92e528-b00e-40ba-9201-9cdc861ea9df None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:14.820219 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 216/426] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Sep 24 20:33:14 2022] GET /identity/v3/role_assignments?group.id=8da22d9b508c45438aa1530d1d88a535&scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa&role.id=3481273c76dc4a20b3f73c4f8ea558e6 => generated 611 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:33:14.873228 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c547aa-6e67-43eb-b4f8-68826ea667cd None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:14.910120 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cae5b-22d4-4caf-9521-e978ba4880e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:14.910729 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cae5b-22d4-4caf-9521-e978ba4880e5 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:14.911005 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cae5b-22d4-4caf-9521-e978ba4880e5 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:14.911277 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cae5b-22d4-4caf-9521-e978ba4880e5 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:14.911923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4cae5b-22d4-4caf-9521-e978ba4880e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:14.912226 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4cae5b-22d4-4caf-9521-e978ba4880e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:14.913662 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4cae5b-22d4-4caf-9521-e978ba4880e5 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:14.923075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 211/427] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:33:14.928776 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92e528-b00e-40ba-9201-9cdc861ea9df None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:15.068783 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92e528-b00e-40ba-9201-9cdc861ea9df None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:15.116954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03226df2-701b-4140-b373-380bc83070a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:15.117975 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03226df2-701b-4140-b373-380bc83070a7 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:15.118496 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03226df2-701b-4140-b373-380bc83070a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:15.119019 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03226df2-701b-4140-b373-380bc83070a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:15.201873 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:15.212264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03226df2-701b-4140-b373-380bc83070a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:15.214129 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03226df2-701b-4140-b373-380bc83070a7 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:15.336681 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 217/428] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:15.343694 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cae5b-22d4-4caf-9521-e978ba4880e5 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:15.447651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:15.471573 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cae5b-22d4-4caf-9521-e978ba4880e5 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:15.516159 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffea97-7d12-4a01-9a77-f402f4ad1296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:15.516915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffea97-7d12-4a01-9a77-f402f4ad1296 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:15.517200 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffea97-7d12-4a01-9a77-f402f4ad1296 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:15.517477 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffea97-7d12-4a01-9a77-f402f4ad1296 None admin] PATH_INFO: `/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:15.518725 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffea97-7d12-4a01-9a77-f402f4ad1296 None admin] RBAC: Authorizing `identity:get_project(project_id=0acc8c7eebf94a958818fae44bb2a0aa)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:15.520291 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffea97-7d12-4a01-9a77-f402f4ad1296 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:15.522378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 212/429] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:33:15 2022] GET /identity/v3/projects/0acc8c7eebf94a958818fae44bb2a0aa => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:15.528810 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03226df2-701b-4140-b373-380bc83070a7 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:15.623644 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:15.650179 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03226df2-701b-4140-b373-380bc83070a7 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:15.688936 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2358442-a655-4206-9b15-d8fc9730dffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:15.689574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2358442-a655-4206-9b15-d8fc9730dffa None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:15.689858 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2358442-a655-4206-9b15-d8fc9730dffa None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:15.690135 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2358442-a655-4206-9b15-d8fc9730dffa None admin] PATH_INFO: `/v3/groups/8da22d9b508c45438aa1530d1d88a535` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:15.691370 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2358442-a655-4206-9b15-d8fc9730dffa None admin] RBAC: Authorizing `identity:get_group(group_id=8da22d9b508c45438aa1530d1d88a535)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:15.692849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2358442-a655-4206-9b15-d8fc9730dffa None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:15.694783 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 218/430] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Sep 24 20:33:15 2022] GET /identity/v3/groups/8da22d9b508c45438aa1530d1d88a535 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:15.700445 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffea97-7d12-4a01-9a77-f402f4ad1296 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:15.812939 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffea97-7d12-4a01-9a77-f402f4ad1296 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:15.847699 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47420f8b-3b6e-4a0c-8fb6-857ec665b1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:15.848308 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47420f8b-3b6e-4a0c-8fb6-857ec665b1eb None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:15.848621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47420f8b-3b6e-4a0c-8fb6-857ec665b1eb None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:15.848895 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47420f8b-3b6e-4a0c-8fb6-857ec665b1eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:15.849624 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47420f8b-3b6e-4a0c-8fb6-857ec665b1eb None admin] RBAC: Adding query filter params (group.id=8da22d9b508c45438aa1530d1d88a535, role.id=905829118b764aa9920810cb3b86e0ce, scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:15.849934 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47420f8b-3b6e-4a0c-8fb6-857ec665b1eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:15.851352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47420f8b-3b6e-4a0c-8fb6-857ec665b1eb None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:15.857775 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 213/431] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Sep 24 20:33:15 2022] GET /identity/v3/role_assignments?group.id=8da22d9b508c45438aa1530d1d88a535&scope.project.id=0acc8c7eebf94a958818fae44bb2a0aa&role.id=905829118b764aa9920810cb3b86e0ce => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:33:16.014236 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cee0c-f985-43ac-b333-56add614def3 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:16.014757 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cee0c-f985-43ac-b333-56add614def3 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:16.015151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cee0c-f985-43ac-b333-56add614def3 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:16.017088 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 219/432] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:16.022946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b37da-4f1d-4678-b64a-898dab0fb1d1 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:16.023379 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b37da-4f1d-4678-b64a-898dab0fb1d1 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:16.023757 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b37da-4f1d-4678-b64a-898dab0fb1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:16.047579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-235b37da-4f1d-4678-b64a-898dab0fb1d1 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:16.048852 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-235b37da-4f1d-4678-b64a-898dab0fb1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:16.051075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:16.128919 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 214/433] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:16.461865 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cee0c-f985-43ac-b333-56add614def3 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:16.569188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cee0c-f985-43ac-b333-56add614def3 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:16.600324 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c75aa-ca97-44ea-a0d5-968f9dfb8574 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:16.600651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c75aa-ca97-44ea-a0d5-968f9dfb8574 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:16.600932 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c75aa-ca97-44ea-a0d5-968f9dfb8574 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:16.602254 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 215/434] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:16.607764 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d1904-e57b-4ddf-b0c3-1cfbe5cf23a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:16.607899 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351e849-52fc-4af4-9cfe-325994bdc07b None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:16.608089 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351e849-52fc-4af4-9cfe-325994bdc07b None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:16.608321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351e849-52fc-4af4-9cfe-325994bdc07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:16.609141 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d1904-e57b-4ddf-b0c3-1cfbe5cf23a1 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:16.609621 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d1904-e57b-4ddf-b0c3-1cfbe5cf23a1 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:16.610090 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d1904-e57b-4ddf-b0c3-1cfbe5cf23a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:16.620801 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d1904-e57b-4ddf-b0c3-1cfbe5cf23a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:16.625955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-487d1904-e57b-4ddf-b0c3-1cfbe5cf23a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:33:16.625955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:16.625955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:16.625955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:16.625955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:16.625955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:16.625955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:16.625955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:16.625955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:16.625955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:16.625955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:16.625955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:16.625955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:16.625955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:16.625955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:16.625955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:16.626836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:16.626836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:16.626836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:16.626836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:16.626836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:16.626836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:16.626836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:16.626836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:16.626836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:16.626836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:16.626836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:16.626836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:16.626836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:16.626836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:16.626836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:16.626836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:16.627646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:16.627646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:16.627646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:16.627646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:16.627646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:16.627646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:16.627646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:16.627646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:16.627646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:16.627646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:16.627646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:33:16.627646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:16.628248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-f351e849-52fc-4af4-9cfe-325994bdc07b None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:16.628804 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-f351e849-52fc-4af4-9cfe-325994bdc07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:16.629755 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 220/435] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:33:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:16.635882 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d1904-e57b-4ddf-b0c3-1cfbe5cf23a1 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:16.644976 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:16.704369 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 216/436] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:16.742040 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d1904-e57b-4ddf-b0c3-1cfbe5cf23a1 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:16.777568 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd0c3c-95c4-4580-ba10-479f61314307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:16.778170 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd0c3c-95c4-4580-ba10-479f61314307 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:16.778446 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd0c3c-95c4-4580-ba10-479f61314307 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:16.778717 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd0c3c-95c4-4580-ba10-479f61314307 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:16.779371 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd0c3c-95c4-4580-ba10-479f61314307 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:16.779672 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd0c3c-95c4-4580-ba10-479f61314307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:16.781072 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd0c3c-95c4-4580-ba10-479f61314307 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:16.793569 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ec50e-ce9a-4d15-8f40-1a60fc2d2646 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:16.793853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ec50e-ce9a-4d15-8f40-1a60fc2d2646 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:16.794125 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ec50e-ce9a-4d15-8f40-1a60fc2d2646 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:16.795259 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 221/437] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:33:16.798480 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 217/438] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:33:16.801052 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd0c3c-95c4-4580-ba10-479f61314307 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:16.803297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482f4f6-db04-4b73-8fad-b95402946ae9 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:16.803613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482f4f6-db04-4b73-8fad-b95402946ae9 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:16.803892 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482f4f6-db04-4b73-8fad-b95402946ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:16.824716 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-e482f4f6-db04-4b73-8fad-b95402946ae9 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:16.825896 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-e482f4f6-db04-4b73-8fad-b95402946ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:16.871551 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:16.890771 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:16.898663 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 218/439] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:33:16.908795 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd0c3c-95c4-4580-ba10-479f61314307 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:16.943464 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71d1a6-83a5-4cea-b194-be8880582030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:16.944062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71d1a6-83a5-4cea-b194-be8880582030 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:16.944420 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71d1a6-83a5-4cea-b194-be8880582030 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:16.944637 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71d1a6-83a5-4cea-b194-be8880582030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:17.013299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71d1a6-83a5-4cea-b194-be8880582030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:17.014671 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71d1a6-83a5-4cea-b194-be8880582030 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:17.046067 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482f4f6-db04-4b73-8fad-b95402946ae9 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:17.080831 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:17.120620 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 222/440] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:17.126619 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71d1a6-83a5-4cea-b194-be8880582030 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:17.151790 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482f4f6-db04-4b73-8fad-b95402946ae9 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:17.192682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652b967-46da-407a-9692-9e153e0a61ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:17.193316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652b967-46da-407a-9692-9e153e0a61ed None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:17.193595 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652b967-46da-407a-9692-9e153e0a61ed None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:17.193876 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652b967-46da-407a-9692-9e153e0a61ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:17.204430 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652b967-46da-407a-9692-9e153e0a61ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:17.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-1652b967-46da-407a-9692-9e153e0a61ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:33:17.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:17.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:17.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:17.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:17.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:17.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:17.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:17.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:17.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:17.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:17.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:17.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:17.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:17.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:17.209264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:17.210112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:17.210112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:17.210112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:17.210112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:17.210112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:17.210112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:17.210112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:17.210112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:17.210112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:17.210112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:17.210112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:17.210112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:17.210112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:17.210112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:17.210112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:17.210112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:17.211079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:17.211079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:17.211079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:17.211079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:17.211079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:17.211079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:17.211079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:17.211079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:17.211079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:17.211079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:17.211079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 20:33:17.211079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:17.211079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 219/441] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:33:17.216584 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652b967-46da-407a-9692-9e153e0a61ed None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:17.242440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71d1a6-83a5-4cea-b194-be8880582030 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:17.274853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:17.277349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97678db-0747-48a0-9e3a-32e0213dd0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:17.277963 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97678db-0747-48a0-9e3a-32e0213dd0b3 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:17.278238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97678db-0747-48a0-9e3a-32e0213dd0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:17.278509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97678db-0747-48a0-9e3a-32e0213dd0b3 None admin] PATH_INFO: `/v3/projects/e9733fd590bc408aa51b7edd8cdd8117` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:17.279670 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97678db-0747-48a0-9e3a-32e0213dd0b3 None admin] RBAC: Authorizing `identity:get_project(project_id=e9733fd590bc408aa51b7edd8cdd8117)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:17.281162 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97678db-0747-48a0-9e3a-32e0213dd0b3 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:17.282786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 223/442] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:33:17 2022] GET /identity/v3/projects/e9733fd590bc408aa51b7edd8cdd8117 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:17.283545 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97678db-0747-48a0-9e3a-32e0213dd0b3 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:17.318180 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:17.322024 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652b967-46da-407a-9692-9e153e0a61ed None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:17.356594 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b7939-246f-4059-a2af-b1cab7a1be8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:17.357192 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b7939-246f-4059-a2af-b1cab7a1be8d None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:17.357486 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b7939-246f-4059-a2af-b1cab7a1be8d None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:17.358161 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b7939-246f-4059-a2af-b1cab7a1be8d None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:17.358821 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b7939-246f-4059-a2af-b1cab7a1be8d None admin] RBAC: Adding query filter params (name=member) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:17.359124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b7939-246f-4059-a2af-b1cab7a1be8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:17.361187 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b7939-246f-4059-a2af-b1cab7a1be8d None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:17.369381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 220/443] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:33:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:33:17.370563 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b7939-246f-4059-a2af-b1cab7a1be8d None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:17.383639 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97678db-0747-48a0-9e3a-32e0213dd0b3 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:17.418300 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e3f25-e097-4ef5-b849-ae087ba4273c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:17.418918 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e3f25-e097-4ef5-b849-ae087ba4273c None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:17.419203 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e3f25-e097-4ef5-b849-ae087ba4273c None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:17.419473 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e3f25-e097-4ef5-b849-ae087ba4273c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:17.429676 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e3f25-e097-4ef5-b849-ae087ba4273c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:17.434448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-8f5e3f25-e097-4ef5-b849-ae087ba4273c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:33:17.434448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:17.434448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:17.434448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:17.434448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:17.434448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:17.434448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:17.434448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:17.434448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:17.434448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:17.434448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:17.434448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:17.434448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:17.434448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:17.434448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:17.434448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:17.435362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:17.435362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:17.435362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:17.435362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:17.435362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:17.435362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:17.435362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:17.435362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:17.435362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:17.435362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:17.435362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:17.435362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:17.435362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:17.435362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:17.435362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:17.435362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:17.436314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:17.436314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:17.436314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:17.436314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:17.436314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:17.436314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:17.436314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:17.436314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:17.436314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:17.436314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:17.436314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 20:33:17.436314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:17.436314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 224/444] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:33:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:17.437025 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e3f25-e097-4ef5-b849-ae087ba4273c None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:17.469292 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b7939-246f-4059-a2af-b1cab7a1be8d None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:17.488849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:17.502745 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047836e-3088-4d04-8fba-db9033c725f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:17.503366 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047836e-3088-4d04-8fba-db9033c725f5 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:17.503645 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047836e-3088-4d04-8fba-db9033c725f5 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:17.503918 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047836e-3088-4d04-8fba-db9033c725f5 None admin] PATH_INFO: `/v3/groups/53241f43e770473cae3b28ca1f14a00f` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:17.505044 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047836e-3088-4d04-8fba-db9033c725f5 None admin] RBAC: Authorizing `identity:get_group(group_id=53241f43e770473cae3b28ca1f14a00f)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:17.506472 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047836e-3088-4d04-8fba-db9033c725f5 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:17.508150 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 221/445] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Sep 24 20:33:17 2022] GET /identity/v3/groups/53241f43e770473cae3b28ca1f14a00f => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:17.511296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047836e-3088-4d04-8fba-db9033c725f5 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:17.537848 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:17.545685 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e3f25-e097-4ef5-b849-ae087ba4273c None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:17.579025 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2918a-f02c-4751-abec-da90d003bb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:17.579615 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2918a-f02c-4751-abec-da90d003bb6a None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:17.579880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2918a-f02c-4751-abec-da90d003bb6a None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:17.580152 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2918a-f02c-4751-abec-da90d003bb6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:17.609764 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047836e-3088-4d04-8fba-db9033c725f5 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:17.642513 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b674cc-2c9d-47cd-9b76-a7b18ccc00d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:17.643106 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b674cc-2c9d-47cd-9b76-a7b18ccc00d5 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:17.643391 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b674cc-2c9d-47cd-9b76-a7b18ccc00d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:17.643661 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b674cc-2c9d-47cd-9b76-a7b18ccc00d5 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:17.644315 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b674cc-2c9d-47cd-9b76-a7b18ccc00d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:17.644656 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b674cc-2c9d-47cd-9b76-a7b18ccc00d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:17.645412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2918a-f02c-4751-abec-da90d003bb6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:17.646011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b674cc-2c9d-47cd-9b76-a7b18ccc00d5 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:17.646846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2918a-f02c-4751-abec-da90d003bb6a None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:17.654179 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 222/446] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:17.654989 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b674cc-2c9d-47cd-9b76-a7b18ccc00d5 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:17.705336 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:17.742087 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:17.748682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 225/447] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:17.749565 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2918a-f02c-4751-abec-da90d003bb6a None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:17.758713 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b674cc-2c9d-47cd-9b76-a7b18ccc00d5 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:17.793487 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789109e-275d-4d77-a773-39a071493b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:17.794020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789109e-275d-4d77-a773-39a071493b24 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:17.794302 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789109e-275d-4d77-a773-39a071493b24 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:17.794578 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789109e-275d-4d77-a773-39a071493b24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:17.795292 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789109e-275d-4d77-a773-39a071493b24 None admin] RBAC: Adding query filter params (group.id=53241f43e770473cae3b28ca1f14a00f, role.id=9cc90aa0ccde4b75b7642101cbf45cf2, scope.project.id=e9733fd590bc408aa51b7edd8cdd8117) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:17.795625 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789109e-275d-4d77-a773-39a071493b24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:17.797078 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789109e-275d-4d77-a773-39a071493b24 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:17.802751 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 223/448] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Sep 24 20:33:17 2022] GET /identity/v3/role_assignments?group.id=53241f43e770473cae3b28ca1f14a00f&scope.project.id=e9733fd590bc408aa51b7edd8cdd8117&role.id=9cc90aa0ccde4b75b7642101cbf45cf2 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:17.803520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789109e-275d-4d77-a773-39a071493b24 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:17.856966 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2918a-f02c-4751-abec-da90d003bb6a None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:17.895388 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4975fe-f58e-4150-bcde-108d71bfdd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:17.896019 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4975fe-f58e-4150-bcde-108d71bfdd72 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:17.896288 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4975fe-f58e-4150-bcde-108d71bfdd72 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:17.896596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4975fe-f58e-4150-bcde-108d71bfdd72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:17.930093 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789109e-275d-4d77-a773-39a071493b24 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:17.946286 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:17.969914 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75ad04-c72f-4be7-a434-ace9734960ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:17.970141 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:17.970868 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75ad04-c72f-4be7-a434-ace9734960ee None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:17.971364 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75ad04-c72f-4be7-a434-ace9734960ee None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:17.971646 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75ad04-c72f-4be7-a434-ace9734960ee None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:17.972964 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75ad04-c72f-4be7-a434-ace9734960ee None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:17.974452 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75ad04-c72f-4be7-a434-ace9734960ee None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:17.976544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 224/449] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:33:17 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:17.981942 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75ad04-c72f-4be7-a434-ace9734960ee None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:17.982548 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4975fe-f58e-4150-bcde-108d71bfdd72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:17.984072 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4975fe-f58e-4150-bcde-108d71bfdd72 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:18.095244 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75ad04-c72f-4be7-a434-ace9734960ee None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:18.102116 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 226/450] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:18.108249 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4975fe-f58e-4150-bcde-108d71bfdd72 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:18.129318 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4688f-1b05-4e37-8ac2-b84756424ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:18.129946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4688f-1b05-4e37-8ac2-b84756424ec8 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:18.130231 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4688f-1b05-4e37-8ac2-b84756424ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:18.130511 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4688f-1b05-4e37-8ac2-b84756424ec8 None admin] PATH_INFO: `/v3/groups/8da22d9b508c45438aa1530d1d88a535` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:18.131629 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4688f-1b05-4e37-8ac2-b84756424ec8 None admin] RBAC: Authorizing `identity:get_group(group_id=8da22d9b508c45438aa1530d1d88a535)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:18.133110 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4688f-1b05-4e37-8ac2-b84756424ec8 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:18.135199 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 225/451] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Sep 24 20:33:17 2022] GET /identity/v3/groups/8da22d9b508c45438aa1530d1d88a535 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:33:18.140925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4688f-1b05-4e37-8ac2-b84756424ec8 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:18.196777 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:18.205658 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:18.211942 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4975fe-f58e-4150-bcde-108d71bfdd72 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:18.245407 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282aa8c5-7ded-44dc-9124-8488594176df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:18.246023 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282aa8c5-7ded-44dc-9124-8488594176df None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:18.246301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282aa8c5-7ded-44dc-9124-8488594176df None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:18.246581 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282aa8c5-7ded-44dc-9124-8488594176df None admin] PATH_INFO: `/v3/projects/aa98305d5a0d465b98d3f7ad7d883522` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:18.246700 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4688f-1b05-4e37-8ac2-b84756424ec8 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:18.247680 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282aa8c5-7ded-44dc-9124-8488594176df None admin] RBAC: Authorizing `identity:get_project(project_id=aa98305d5a0d465b98d3f7ad7d883522)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:18.249154 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282aa8c5-7ded-44dc-9124-8488594176df None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:18.250907 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 227/452] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Sep 24 20:33:18 2022] GET /identity/v3/projects/aa98305d5a0d465b98d3f7ad7d883522 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:33:18.256086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282aa8c5-7ded-44dc-9124-8488594176df None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:18.279897 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1836a8f-8999-4a3e-8796-0c912202eb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:18.280752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1836a8f-8999-4a3e-8796-0c912202eb71 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:18.281036 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1836a8f-8999-4a3e-8796-0c912202eb71 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:18.281307 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1836a8f-8999-4a3e-8796-0c912202eb71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:18.282019 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1836a8f-8999-4a3e-8796-0c912202eb71 None admin] RBAC: Adding query filter params (group.id=8da22d9b508c45438aa1530d1d88a535, role.id=3481273c76dc4a20b3f73c4f8ea558e6, scope.project.id=aa98305d5a0d465b98d3f7ad7d883522) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:18.282328 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1836a8f-8999-4a3e-8796-0c912202eb71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:18.283734 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1836a8f-8999-4a3e-8796-0c912202eb71 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:18.289396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 226/453] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Sep 24 20:33:18 2022] GET /identity/v3/role_assignments?group.id=8da22d9b508c45438aa1530d1d88a535&scope.project.id=aa98305d5a0d465b98d3f7ad7d883522&role.id=3481273c76dc4a20b3f73c4f8ea558e6 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:33:18.359105 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282aa8c5-7ded-44dc-9124-8488594176df None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:18.394878 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4f770-fa9a-4335-9e6b-bf4f80d23d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:18.395511 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4f770-fa9a-4335-9e6b-bf4f80d23d5f None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:18.395788 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4f770-fa9a-4335-9e6b-bf4f80d23d5f None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:18.396060 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4f770-fa9a-4335-9e6b-bf4f80d23d5f None admin] PATH_INFO: `/v3/groups/8da22d9b508c45438aa1530d1d88a535` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:18.397236 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4f770-fa9a-4335-9e6b-bf4f80d23d5f None admin] RBAC: Authorizing `identity:get_group(group_id=8da22d9b508c45438aa1530d1d88a535)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:18.398800 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4f770-fa9a-4335-9e6b-bf4f80d23d5f None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:18.400451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 228/454] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Sep 24 20:33:18 2022] GET /identity/v3/groups/8da22d9b508c45438aa1530d1d88a535 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:33:18.406444 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1836a8f-8999-4a3e-8796-0c912202eb71 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:18.511107 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1836a8f-8999-4a3e-8796-0c912202eb71 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:18.526942 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:18.548167 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2352e-5660-4b07-b7ca-b3baa7ce8254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:18.548798 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2352e-5660-4b07-b7ca-b3baa7ce8254 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:18.549080 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2352e-5660-4b07-b7ca-b3baa7ce8254 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:18.549378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2352e-5660-4b07-b7ca-b3baa7ce8254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:18.550105 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2352e-5660-4b07-b7ca-b3baa7ce8254 None admin] RBAC: Adding query filter params (group.id=8da22d9b508c45438aa1530d1d88a535, role.id=905829118b764aa9920810cb3b86e0ce, scope.project.id=aa98305d5a0d465b98d3f7ad7d883522) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:18.550417 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2352e-5660-4b07-b7ca-b3baa7ce8254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:18.551836 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2352e-5660-4b07-b7ca-b3baa7ce8254 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:18.557718 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 227/455] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Sep 24 20:33:18 2022] GET /identity/v3/role_assignments?group.id=8da22d9b508c45438aa1530d1d88a535&scope.project.id=aa98305d5a0d465b98d3f7ad7d883522&role.id=905829118b764aa9920810cb3b86e0ce => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:21.396034 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88894c2f-30ca-4b8c-9f7e-68e32c187737 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:21.397163 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88894c2f-30ca-4b8c-9f7e-68e32c187737 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:21.397647 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88894c2f-30ca-4b8c-9f7e-68e32c187737 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:21.400147 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 229/456] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:21.405796 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b68aa-9882-4585-93b6-cb7bf3d9e360 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:21.406658 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b68aa-9882-4585-93b6-cb7bf3d9e360 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:21.407146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b68aa-9882-4585-93b6-cb7bf3d9e360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:21.426015 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-4c0b68aa-9882-4585-93b6-cb7bf3d9e360 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:21.427479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-4c0b68aa-9882-4585-93b6-cb7bf3d9e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:21.499989 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 228/457] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:21.640098 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b5578-7b29-4a8a-8da1-8b7baaf6576c None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:21.640775 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b5578-7b29-4a8a-8da1-8b7baaf6576c None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:21.641271 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b5578-7b29-4a8a-8da1-8b7baaf6576c None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:21.643030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 230/458] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:21.648110 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3c72a-3b59-4002-82fe-5e8163091d6e None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:21.648485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3c72a-3b59-4002-82fe-5e8163091d6e None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:21.648718 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3c72a-3b59-4002-82fe-5e8163091d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:21.668694 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-65d3c72a-3b59-4002-82fe-5e8163091d6e None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:21.669882 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-65d3c72a-3b59-4002-82fe-5e8163091d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:21.744546 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 229/459] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:33:21.759462 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a8c42-811b-4b13-b29a-b9bc7337fb3b None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:21.759749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a8c42-811b-4b13-b29a-b9bc7337fb3b None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:21.760028 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a8c42-811b-4b13-b29a-b9bc7337fb3b None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:21.761729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 231/460] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:21.766814 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9e49-1539-45f7-b4d7-8121ff3b0dd3 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:21.767108 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9e49-1539-45f7-b4d7-8121ff3b0dd3 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:21.767392 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d9e49-1539-45f7-b4d7-8121ff3b0dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:21.786878 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-fd1d9e49-1539-45f7-b4d7-8121ff3b0dd3 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:21.788045 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-fd1d9e49-1539-45f7-b4d7-8121ff3b0dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:21.819718 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:21.831143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a8c42-811b-4b13-b29a-b9bc7337fb3b None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:21.865716 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:21.872384 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 230/461] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:21.947192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a8c42-811b-4b13-b29a-b9bc7337fb3b None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:21.982174 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c3e9d-f6f5-4352-914d-0973b73f8014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:21.983005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c3e9d-f6f5-4352-914d-0973b73f8014 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:21.983424 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c3e9d-f6f5-4352-914d-0973b73f8014 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:21.983854 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c3e9d-f6f5-4352-914d-0973b73f8014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:21.995126 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c3e9d-f6f5-4352-914d-0973b73f8014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:21.996737 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c3e9d-f6f5-4352-914d-0973b73f8014 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:22.012292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-969c3e9d-f6f5-4352-914d-0973b73f8014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:22.012292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:22.012292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:22.012292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:22.012292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:22.012292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:22.012292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:22.012292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:22.012292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:22.012292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:22.012292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:22.012292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:22.012292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:22.012292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:22.012292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:22.012292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:22.013234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:22.014070 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:22.014070 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:22.014070 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:22.014070 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 232/462] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:22.021030 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d9e49-1539-45f7-b4d7-8121ff3b0dd3 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:22.048359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbaeb6-ea6f-40b9-bd1c-b97b1bc76792 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:22.048359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbaeb6-ea6f-40b9-bd1c-b97b1bc76792 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:22.048359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbaeb6-ea6f-40b9-bd1c-b97b1bc76792 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:22.048359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 233/463] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:22.051350 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db4899-8f7c-4718-ae28-7a3e565d609f None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:22.051638 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db4899-8f7c-4718-ae28-7a3e565d609f None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:22.051914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db4899-8f7c-4718-ae28-7a3e565d609f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:22.072268 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-c0db4899-8f7c-4718-ae28-7a3e565d609f None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:22.073657 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-c0db4899-8f7c-4718-ae28-7a3e565d609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:22.134751 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d9e49-1539-45f7-b4d7-8121ff3b0dd3 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:22.144535 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 234/464] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:33:22.145530 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db4899-8f7c-4718-ae28-7a3e565d609f None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:22.160793 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:22.186185 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9772370-dc15-4299-8dfe-cc5d89050ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:22.187101 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9772370-dc15-4299-8dfe-cc5d89050ec1 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:22.187580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9772370-dc15-4299-8dfe-cc5d89050ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:22.188047 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9772370-dc15-4299-8dfe-cc5d89050ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:22.188923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9772370-dc15-4299-8dfe-cc5d89050ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:22.189444 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9772370-dc15-4299-8dfe-cc5d89050ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:22.191523 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9772370-dc15-4299-8dfe-cc5d89050ec1 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:22.208374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 231/465] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:22.214504 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9772370-dc15-4299-8dfe-cc5d89050ec1 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:22.247543 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:22.264903 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db4899-8f7c-4718-ae28-7a3e565d609f None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:22.300473 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3bdb1-cae8-401f-a52f-cd901e4d2b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:22.301207 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3bdb1-cae8-401f-a52f-cd901e4d2b5e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:22.301537 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3bdb1-cae8-401f-a52f-cd901e4d2b5e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:22.301819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3bdb1-cae8-401f-a52f-cd901e4d2b5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:22.312533 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3bdb1-cae8-401f-a52f-cd901e4d2b5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:22.314004 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f3bdb1-cae8-401f-a52f-cd901e4d2b5e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:22.323416 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9772370-dc15-4299-8dfe-cc5d89050ec1 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:22.330594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-05f3bdb1-cae8-401f-a52f-cd901e4d2b5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:22.330594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:22.330594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:22.330594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:22.330594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:22.330594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:22.330594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:22.330594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:22.330594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:22.330594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:22.330594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:22.330594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:22.330594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:22.330594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:22.330594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:22.330594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:22.331469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:22.332294 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:22.332294 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:22.332294 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:22.332935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 235/466] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:22.333335 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3bdb1-cae8-401f-a52f-cd901e4d2b5e None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:22.362001 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4d0ca-e9cc-49e4-947c-3ccf7110fcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:22.362920 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4d0ca-e9cc-49e4-947c-3ccf7110fcd7 None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:22.363403 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4d0ca-e9cc-49e4-947c-3ccf7110fcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:22.363879 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4d0ca-e9cc-49e4-947c-3ccf7110fcd7 None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:22.364546 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4d0ca-e9cc-49e4-947c-3ccf7110fcd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:22.365975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4d0ca-e9cc-49e4-947c-3ccf7110fcd7 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:22.387889 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 232/467] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Sep 24 20:33:22 2022] POST /identity/v3/users => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:33:22.388669 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4d0ca-e9cc-49e4-947c-3ccf7110fcd7 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:22.422271 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:22.475142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3bdb1-cae8-401f-a52f-cd901e4d2b5e None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:22.505261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:22.517133 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1ce1f-8c20-49fe-b6ab-98b75b6981d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:22.518067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1ce1f-8c20-49fe-b6ab-98b75b6981d2 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:22.518362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1ce1f-8c20-49fe-b6ab-98b75b6981d2 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:22.518667 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1ce1f-8c20-49fe-b6ab-98b75b6981d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:22.526108 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4d0ca-e9cc-49e4-947c-3ccf7110fcd7 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:22.531951 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1ce1f-8c20-49fe-b6ab-98b75b6981d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:22.533496 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1ce1f-8c20-49fe-b6ab-98b75b6981d2 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:22.549010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-93f1ce1f-8c20-49fe-b6ab-98b75b6981d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:22.549010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:22.549010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:22.549010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:22.549010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:22.549010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:22.549010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:22.549010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:22.549010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:22.549010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:22.549010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:22.549010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:22.549010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:22.549010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:22.549010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:22.549010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:22.550007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:22.550916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:22.550916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:22.550916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:22.550916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 236/468] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:22.552175 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1ce1f-8c20-49fe-b6ab-98b75b6981d2 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:22.570299 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67471b3f-9f91-4af9-b079-92f48a1beb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:22.570923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67471b3f-9f91-4af9-b079-92f48a1beb0a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:22.571237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67471b3f-9f91-4af9-b079-92f48a1beb0a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:22.572043 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67471b3f-9f91-4af9-b079-92f48a1beb0a None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:22.572744 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67471b3f-9f91-4af9-b079-92f48a1beb0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:22.573056 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67471b3f-9f91-4af9-b079-92f48a1beb0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:22.574434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67471b3f-9f91-4af9-b079-92f48a1beb0a None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:22.587423 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 233/469] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:22.588385 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67471b3f-9f91-4af9-b079-92f48a1beb0a None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:22.684987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1ce1f-8c20-49fe-b6ab-98b75b6981d2 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:22.704141 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:22.707963 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67471b3f-9f91-4af9-b079-92f48a1beb0a None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:22.727079 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dceb1a-110a-4828-ae53-fc973e37f336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:22.727762 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dceb1a-110a-4828-ae53-fc973e37f336 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:22.728041 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dceb1a-110a-4828-ae53-fc973e37f336 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:22.728316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dceb1a-110a-4828-ae53-fc973e37f336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:22.738864 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dceb1a-110a-4828-ae53-fc973e37f336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:22.740311 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dceb1a-110a-4828-ae53-fc973e37f336 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:22.745357 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f26e6-914a-431c-a889-c13f3b631a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:22.745961 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f26e6-914a-431c-a889-c13f3b631a70 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:22.746244 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f26e6-914a-431c-a889-c13f3b631a70 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:22.746519 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f26e6-914a-431c-a889-c13f3b631a70 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:22.747156 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f26e6-914a-431c-a889-c13f3b631a70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:22.747460 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f26e6-914a-431c-a889-c13f3b631a70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:22.748855 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f26e6-914a-431c-a889-c13f3b631a70 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:22.755081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-a8dceb1a-110a-4828-ae53-fc973e37f336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:22.755081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:22.755081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:22.755081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:22.755081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:22.755081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:22.755081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:22.755081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:22.755081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:22.755081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:22.755081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:22.755081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:22.755081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:22.755081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:22.755081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:22.755081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:22.756009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:22.757186 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:22.757186 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:22.757186 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:22.757186 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 237/470] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:22.757186 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dceb1a-110a-4828-ae53-fc973e37f336 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:22.766710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 234/471] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:22.768470 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f26e6-914a-431c-a889-c13f3b631a70 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:22.775348 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:22.866977 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dceb1a-110a-4828-ae53-fc973e37f336 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:22.879758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f26e6-914a-431c-a889-c13f3b631a70 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:22.902889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4329a8-47ae-477a-b5a4-2fc198830839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:22.903508 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4329a8-47ae-477a-b5a4-2fc198830839 None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:22.903778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4329a8-47ae-477a-b5a4-2fc198830839 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:22.904052 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4329a8-47ae-477a-b5a4-2fc198830839 None admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:22.904730 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4329a8-47ae-477a-b5a4-2fc198830839 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:22.906153 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4329a8-47ae-477a-b5a4-2fc198830839 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:22.916882 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656244b-d67d-4ab6-9487-85f0df7298c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:22.917498 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656244b-d67d-4ab6-9487-85f0df7298c3 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:22.917783 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656244b-d67d-4ab6-9487-85f0df7298c3 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:22.918063 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656244b-d67d-4ab6-9487-85f0df7298c3 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:22.918696 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656244b-d67d-4ab6-9487-85f0df7298c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:22.919005 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656244b-d67d-4ab6-9487-85f0df7298c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:22.920572 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656244b-d67d-4ab6-9487-85f0df7298c3 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:22.928327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 238/472] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Sep 24 20:33:22 2022] POST /identity/v3/users => generated 248 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:33:22.929147 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4329a8-47ae-477a-b5a4-2fc198830839 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:22.942400 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 235/473] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:22.947776 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656244b-d67d-4ab6-9487-85f0df7298c3 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:22.973120 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:23.036494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:23.082307 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656244b-d67d-4ab6-9487-85f0df7298c3 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:23.084434 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4329a8-47ae-477a-b5a4-2fc198830839 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:23.123389 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619526b1-f80c-4552-90da-8a6ac148eb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:23.124399 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619526b1-f80c-4552-90da-8a6ac148eb6c None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:23.124595 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619526b1-f80c-4552-90da-8a6ac148eb6c None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:23.125098 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619526b1-f80c-4552-90da-8a6ac148eb6c None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:23.125857 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619526b1-f80c-4552-90da-8a6ac148eb6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:23.127651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619526b1-f80c-4552-90da-8a6ac148eb6c None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:23.137591 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bd14a-8ac6-4920-a089-fe6ca1d82135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:23.138082 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd14a-8ac6-4920-a089-fe6ca1d82135 None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:23.138508 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd14a-8ac6-4920-a089-fe6ca1d82135 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:23.138792 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bd14a-8ac6-4920-a089-fe6ca1d82135 None admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:23.139669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bd14a-8ac6-4920-a089-fe6ca1d82135 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:23.141164 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bd14a-8ac6-4920-a089-fe6ca1d82135 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:23.153885 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 236/474] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Sep 24 20:33:22 2022] POST /identity/v3/users => generated 249 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:33:23.177410 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 239/475] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Sep 24 20:33:22 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:33:24.917483 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026add-71b2-4f59-9d6c-154c4a7d130b None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:24.918004 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026add-71b2-4f59-9d6c-154c4a7d130b None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:24.918004 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026add-71b2-4f59-9d6c-154c4a7d130b None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:24.919563 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 237/476] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:24.926891 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423d069-91c7-4103-8880-03d0e3a6b788 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:24.926891 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423d069-91c7-4103-8880-03d0e3a6b788 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:24.926891 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423d069-91c7-4103-8880-03d0e3a6b788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:24.945145 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-a423d069-91c7-4103-8880-03d0e3a6b788 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:24.946844 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-a423d069-91c7-4103-8880-03d0e3a6b788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:25.020859 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 240/477] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:25.358182 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026add-71b2-4f59-9d6c-154c4a7d130b None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:25.466300 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026add-71b2-4f59-9d6c-154c4a7d130b None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:25.487686 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:25.507033 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988a452-97c7-4501-ac5a-d54ab166b20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:25.508034 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988a452-97c7-4501-ac5a-d54ab166b20a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:25.508579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988a452-97c7-4501-ac5a-d54ab166b20a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:25.509197 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988a452-97c7-4501-ac5a-d54ab166b20a None admin] PATH_INFO: `/v3/roles/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:25.521045 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988a452-97c7-4501-ac5a-d54ab166b20a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:25.526195 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658a30b-d97c-4f47-9c66-006c66acea83 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:25.526479 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658a30b-d97c-4f47-9c66-006c66acea83 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:25.526753 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658a30b-d97c-4f47-9c66-006c66acea83 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:25.527641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-b988a452-97c7-4501-ac5a-d54ab166b20a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:25.527641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:25.527641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:25.527641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:25.527641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:25.527641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:25.527641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:25.527641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:25.527641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:25.527641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:25.527641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:25.527641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:25.527641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:25.527641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:25.527641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:25.527641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:25.528509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:25.528509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:25.528509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:25.528509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:25.528509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:25.528509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:25.528509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:25.528509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:25.528509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:25.528509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:25.528509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:25.528509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:25.528509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:25.528509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:25.528509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:25.528509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:25.529327 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:25.529327 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:25.529327 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:25.529327 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:25.529327 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:25.529327 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:25.529327 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:25.529327 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:25.529327 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:25.529327 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:25.529327 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:25.529327 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:25.529926 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 241/478] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:25.531881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 238/479] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:33:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:25.533985 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ffde7-21a3-4312-9986-c4df27060d55 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:25.534475 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ffde7-21a3-4312-9986-c4df27060d55 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:25.534959 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ffde7-21a3-4312-9986-c4df27060d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:25.538709 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988a452-97c7-4501-ac5a-d54ab166b20a None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:25.554590 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-a10ffde7-21a3-4312-9986-c4df27060d55 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:25.556501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-a10ffde7-21a3-4312-9986-c4df27060d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:25.604721 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:25.636845 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 242/480] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:25.658633 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988a452-97c7-4501-ac5a-d54ab166b20a None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:25.680887 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ab96-77e9-489f-b3ef-f4da33c0c36b None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:25.681540 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ab96-77e9-489f-b3ef-f4da33c0c36b None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:25.682015 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ab96-77e9-489f-b3ef-f4da33c0c36b None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:25.683798 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 243/481] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:33:25.688609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b58092-056e-4f08-b525-cf0759896c63 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:25.688892 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b58092-056e-4f08-b525-cf0759896c63 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:25.689171 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b58092-056e-4f08-b525-cf0759896c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:25.694662 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fe9d6-505a-4f8f-8932-02cb1d91759c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:25.695267 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fe9d6-505a-4f8f-8932-02cb1d91759c None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:25.695707 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fe9d6-505a-4f8f-8932-02cb1d91759c None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:25.695992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fe9d6-505a-4f8f-8932-02cb1d91759c None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:25.698161 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fe9d6-505a-4f8f-8932-02cb1d91759c None admin] RBAC: Adding query filter params (name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:25.698469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fe9d6-505a-4f8f-8932-02cb1d91759c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:25.699829 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fe9d6-505a-4f8f-8932-02cb1d91759c None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:25.708637 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-55b58092-056e-4f08-b525-cf0759896c63 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:25.709240 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 239/482] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Sep 24 20:33:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:25.709815 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-55b58092-056e-4f08-b525-cf0759896c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:25.714780 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fe9d6-505a-4f8f-8932-02cb1d91759c None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:25.768382 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:25.786032 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 244/483] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:33:25.787286 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45996df0-ca7d-430a-84a6-3b05e37f7029 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:25.787568 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45996df0-ca7d-430a-84a6-3b05e37f7029 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:25.787839 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45996df0-ca7d-430a-84a6-3b05e37f7029 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:25.789222 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 245/484] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:25.795112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940705a3-8f6f-4236-8adf-5fd6f4e8c2bc None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:25.795392 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940705a3-8f6f-4236-8adf-5fd6f4e8c2bc None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:25.795667 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940705a3-8f6f-4236-8adf-5fd6f4e8c2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:25.813701 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-940705a3-8f6f-4236-8adf-5fd6f4e8c2bc None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:25.814922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-940705a3-8f6f-4236-8adf-5fd6f4e8c2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:25.842672 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fe9d6-505a-4f8f-8932-02cb1d91759c None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:25.886943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d54e2b-8a5e-497b-a50b-51a72a526b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:25.888003 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d54e2b-8a5e-497b-a50b-51a72a526b3e None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:25.888864 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d54e2b-8a5e-497b-a50b-51a72a526b3e None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:25.889339 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d54e2b-8a5e-497b-a50b-51a72a526b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:25.900744 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d54e2b-8a5e-497b-a50b-51a72a526b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:25.901062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 246/485] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:33:25.902628 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d54e2b-8a5e-497b-a50b-51a72a526b3e None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:25.917667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-14d54e2b-8a5e-497b-a50b-51a72a526b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:25.917667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:25.917667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:25.917667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:25.917667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:25.917667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:25.917667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:25.917667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:25.917667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:25.917667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:25.917667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:25.917667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:25.917667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:25.917667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:25.917667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:25.917667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:25.919132 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:25.919992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:25.919992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:25.919992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:25.921692 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 240/486] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:33:25.930365 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940705a3-8f6f-4236-8adf-5fd6f4e8c2bc None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:25.931761 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:25.967741 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d54e2b-8a5e-497b-a50b-51a72a526b3e None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:26.052899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940705a3-8f6f-4236-8adf-5fd6f4e8c2bc None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:26.092760 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:26.097456 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ca447-fe5f-4cfd-b85a-860a835ecc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:26.098313 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ca447-fe5f-4cfd-b85a-860a835ecc04 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:26.098813 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ca447-fe5f-4cfd-b85a-860a835ecc04 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:26.099273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ca447-fe5f-4cfd-b85a-860a835ecc04 None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:26.100100 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ca447-fe5f-4cfd-b85a-860a835ecc04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:26.100960 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ca447-fe5f-4cfd-b85a-860a835ecc04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:26.101068 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d54e2b-8a5e-497b-a50b-51a72a526b3e None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:26.103124 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ca447-fe5f-4cfd-b85a-860a835ecc04 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:26.123050 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 247/487] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:26.134780 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ca447-fe5f-4cfd-b85a-860a835ecc04 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:26.142454 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be1c15-756b-4bb5-8391-d039c36a6282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:26.143029 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be1c15-756b-4bb5-8391-d039c36a6282 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:26.143310 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be1c15-756b-4bb5-8391-d039c36a6282 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:26.143583 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be1c15-756b-4bb5-8391-d039c36a6282 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:26.154714 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be1c15-756b-4bb5-8391-d039c36a6282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:26.159945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-87be1c15-756b-4bb5-8391-d039c36a6282 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:26.159945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:26.159945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:26.159945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:26.159945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:26.159945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:26.159945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:26.159945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:26.159945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:26.159945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:26.159945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:26.159945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:26.159945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:26.159945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:26.159945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:26.159945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:26.160873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:26.160873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:26.160873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:26.160873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:26.160873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:26.160873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:26.160873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:26.160873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:26.160873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:26.160873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:26.160873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:26.160873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:26.160873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:26.160873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:26.160873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:26.160873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:26.161667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:26.161667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:26.161667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:26.161667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:26.161667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:26.161667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:26.161667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:26.161667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:26.161667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:26.161667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:26.161667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:26.161667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:26.161667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 241/488] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:33:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:33:26.167785 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be1c15-756b-4bb5-8391-d039c36a6282 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:26.200738 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:26.240310 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ca447-fe5f-4cfd-b85a-860a835ecc04 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:26.278967 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaf00b-7621-49f3-802b-e560e3a3f41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:26.279597 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaf00b-7621-49f3-802b-e560e3a3f41b None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:26.279878 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaf00b-7621-49f3-802b-e560e3a3f41b None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:26.280069 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be1c15-756b-4bb5-8391-d039c36a6282 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:26.280165 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaf00b-7621-49f3-802b-e560e3a3f41b None admin] PATH_INFO: `/v3/users/nova` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:26.287328 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbaf00b-7621-49f3-802b-e560e3a3f41b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:26.288808 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbaf00b-7621-49f3-802b-e560e3a3f41b None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:26.301767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-3fbaf00b-7621-49f3-802b-e560e3a3f41b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 20:33:26.301767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:26.301767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:26.301767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:26.301767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:26.301767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:26.301767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:26.301767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:26.301767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:26.301767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:26.301767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:26.301767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:26.301767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:33:26.301767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:33:26.301767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:33:26.301767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:26.302703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:26.303626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:26.303626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:26.303626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:33:26.303626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:33:26.303626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:33:26.303626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:33:26.303626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:33:26.303626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:33:26.303626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 20:33:26.303626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:26.303626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 248/489] 10.222.0.61 () {56 vars in 1093 bytes} [Sat Sep 24 20:33:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:33:26.303626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaf00b-7621-49f3-802b-e560e3a3f41b None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:26.316869 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80726e06-1721-435d-b18b-9f5188597b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:26.317494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80726e06-1721-435d-b18b-9f5188597b63 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:26.317770 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80726e06-1721-435d-b18b-9f5188597b63 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:26.318042 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80726e06-1721-435d-b18b-9f5188597b63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:26.328761 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80726e06-1721-435d-b18b-9f5188597b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:26.333874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-80726e06-1721-435d-b18b-9f5188597b63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:26.333874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:26.333874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:26.333874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:26.333874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:26.333874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:26.333874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:26.333874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:26.333874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:26.333874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:26.333874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:26.333874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:26.333874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:26.333874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:26.333874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:26.333874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:26.334748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:26.334748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:26.334748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:26.334748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:26.334748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:26.334748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:26.334748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:26.334748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:26.334748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:26.334748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:26.334748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:26.334748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:26.334748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:26.334748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:26.334748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:26.334748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:26.335538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:26.335538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:26.335538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:26.335538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:26.335538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:26.335538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:26.335538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:26.335538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:26.335538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:26.335538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:26.335538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:26.335538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:26.335538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 242/490] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:33:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:26.336181 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80726e06-1721-435d-b18b-9f5188597b63 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:26.350923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:26.404610 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaf00b-7621-49f3-802b-e560e3a3f41b None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:26.426724 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:26.433850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80726e06-1721-435d-b18b-9f5188597b63 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:26.438391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31b69d-bd78-46d3-80f5-2072bad700fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:26.438987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31b69d-bd78-46d3-80f5-2072bad700fc None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:26.439267 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31b69d-bd78-46d3-80f5-2072bad700fc None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:26.439540 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31b69d-bd78-46d3-80f5-2072bad700fc None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:26.440196 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31b69d-bd78-46d3-80f5-2072bad700fc None admin] RBAC: Adding query filter params (name=service) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:26.440539 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31b69d-bd78-46d3-80f5-2072bad700fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:26.441940 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31b69d-bd78-46d3-80f5-2072bad700fc None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:26.450201 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 249/491] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Sep 24 20:33:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:26.451072 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31b69d-bd78-46d3-80f5-2072bad700fc None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:26.471159 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133be245-3b76-451f-9dfd-f700e64fad2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:26.471779 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133be245-3b76-451f-9dfd-f700e64fad2b None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:26.472057 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133be245-3b76-451f-9dfd-f700e64fad2b None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:26.472329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133be245-3b76-451f-9dfd-f700e64fad2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:26.483081 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133be245-3b76-451f-9dfd-f700e64fad2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:26.489257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-133be245-3b76-451f-9dfd-f700e64fad2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:26.489257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:26.489257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:26.489257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:26.489257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:26.489257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:26.489257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:26.489257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:26.489257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:26.489257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:26.489257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:26.489257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:26.489257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:26.489257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:26.489257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:26.489257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:26.490280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:26.490280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:26.490280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:26.490280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:26.490280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:26.490280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:26.490280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:26.490280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:26.490280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:26.490280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:26.490280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:26.490280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:26.490280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:26.490280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:26.490280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:26.490280 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:26.491320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:26.491320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:26.491320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:26.491320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:26.491320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:26.491320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:26.491320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:26.491320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:26.491320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:26.491320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:26.491320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:26.491320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:26.491320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 243/492] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:33:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:26.492115 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133be245-3b76-451f-9dfd-f700e64fad2b None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:26.549561 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31b69d-bd78-46d3-80f5-2072bad700fc None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:26.566688 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:26.582594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd27dd-5024-4573-a88f-25b386483e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:26.583188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd27dd-5024-4573-a88f-25b386483e62 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:26.583462 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd27dd-5024-4573-a88f-25b386483e62 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:26.583729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd27dd-5024-4573-a88f-25b386483e62 None admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:26.584503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd27dd-5024-4573-a88f-25b386483e62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:26.584807 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd27dd-5024-4573-a88f-25b386483e62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:26.586306 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd27dd-5024-4573-a88f-25b386483e62 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:26.591882 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133be245-3b76-451f-9dfd-f700e64fad2b None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:26.623847 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 250/493] 10.222.0.61 () {56 vars in 1133 bytes} [Sat Sep 24 20:33:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:26.624731 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd27dd-5024-4573-a88f-25b386483e62 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:26.630417 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075966fc-4301-4c91-b6a0-67c4406d7e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:26.631025 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075966fc-4301-4c91-b6a0-67c4406d7e1f None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:26.631304 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075966fc-4301-4c91-b6a0-67c4406d7e1f None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:26.631571 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075966fc-4301-4c91-b6a0-67c4406d7e1f None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:26.632225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075966fc-4301-4c91-b6a0-67c4406d7e1f None admin] RBAC: Adding query filter params (name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:26.632562 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075966fc-4301-4c91-b6a0-67c4406d7e1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:26.633967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075966fc-4301-4c91-b6a0-67c4406d7e1f None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:26.641923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 244/494] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Sep 24 20:33:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:26.642688 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075966fc-4301-4c91-b6a0-67c4406d7e1f None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:26.672311 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:26.727812 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd27dd-5024-4573-a88f-25b386483e62 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:26.744258 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075966fc-4301-4c91-b6a0-67c4406d7e1f None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:26.761228 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d0532-d433-4cc5-948d-bc0babb492b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:26.761848 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0532-d433-4cc5-948d-bc0babb492b4 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:26.762135 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0532-d433-4cc5-948d-bc0babb492b4 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:26.762408 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0532-d433-4cc5-948d-bc0babb492b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:26.772041 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d0532-d433-4cc5-948d-bc0babb492b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:26.773537 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d0532-d433-4cc5-948d-bc0babb492b4 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:26.776670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f21242-0539-440e-a4b4-3d243d22a0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:26.777569 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f21242-0539-440e-a4b4-3d243d22a0a4 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:26.777850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f21242-0539-440e-a4b4-3d243d22a0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:26.778126 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f21242-0539-440e-a4b4-3d243d22a0a4 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:26.778811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f21242-0539-440e-a4b4-3d243d22a0a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:26.779117 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f21242-0539-440e-a4b4-3d243d22a0a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:26.780544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f21242-0539-440e-a4b4-3d243d22a0a4 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:26.783002 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:26.788693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-6d8d0532-d433-4cc5-948d-bc0babb492b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:26.788693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:26.788693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:26.788693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:26.788693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:26.788693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:26.788693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:26.788693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:26.788693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:26.788693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:26.788693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:26.788693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:26.788693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:26.788693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:26.788693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:26.788693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:26.789688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:26.790780 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:26.790780 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:26.790780 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:26.790780 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 251/495] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:26.791272 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 245/496] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Sep 24 20:33:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:26.791592 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d0532-d433-4cc5-948d-bc0babb492b4 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:26.791664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f21242-0539-440e-a4b4-3d243d22a0a4 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:26.887283 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:26.894421 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d0532-d433-4cc5-948d-bc0babb492b4 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:26.896835 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f21242-0539-440e-a4b4-3d243d22a0a4 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:26.926678 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b384725-8685-43e6-a93c-020bb60be063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:26.927205 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b384725-8685-43e6-a93c-020bb60be063 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:26.927479 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b384725-8685-43e6-a93c-020bb60be063 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:26.927748 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b384725-8685-43e6-a93c-020bb60be063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:26.929547 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b347b15-61d9-44d5-badf-111806537d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:26.930171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b347b15-61d9-44d5-badf-111806537d16 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:26.930958 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b347b15-61d9-44d5-badf-111806537d16 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:26.931233 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b347b15-61d9-44d5-badf-111806537d16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:26.941566 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b347b15-61d9-44d5-badf-111806537d16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:26.943071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b347b15-61d9-44d5-badf-111806537d16 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:26.957577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-1b347b15-61d9-44d5-badf-111806537d16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:26.957577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:26.957577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:26.957577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:26.957577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:26.957577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:26.957577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:26.957577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:26.957577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:26.957577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:26.957577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:26.957577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:26.957577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:26.957577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:26.957577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:26.957577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:26.958518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:26.959350 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:26.959350 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:26.959350 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:26.959350 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 246/497] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:26.959582 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b347b15-61d9-44d5-badf-111806537d16 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:27.000769 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b384725-8685-43e6-a93c-020bb60be063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:27.002240 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b384725-8685-43e6-a93c-020bb60be063 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:27.009877 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:27.061299 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b347b15-61d9-44d5-badf-111806537d16 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:27.093273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:27.094557 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27969a63-ab20-4503-be9b-63f699c68d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:27.095251 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27969a63-ab20-4503-be9b-63f699c68d8a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:27.095530 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27969a63-ab20-4503-be9b-63f699c68d8a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:27.095834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27969a63-ab20-4503-be9b-63f699c68d8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:27.100969 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 252/498] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:27.101772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b384725-8685-43e6-a93c-020bb60be063 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:27.107711 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27969a63-ab20-4503-be9b-63f699c68d8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:27.109213 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27969a63-ab20-4503-be9b-63f699c68d8a None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:27.124641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-27969a63-ab20-4503-be9b-63f699c68d8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:27.124641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:27.124641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:27.124641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:27.124641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:27.124641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:27.124641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:27.124641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:27.124641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:27.124641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:27.124641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:27.124641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:27.124641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:27.124641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:27.124641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:27.124641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:27.125600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:27.126459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:27.126459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:27.126459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:27.126459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 247/499] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:27.127525 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27969a63-ab20-4503-be9b-63f699c68d8a None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:27.207677 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b384725-8685-43e6-a93c-020bb60be063 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:27.226899 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27969a63-ab20-4503-be9b-63f699c68d8a None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:27.228949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:27.241590 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080525bc-21f5-46fc-9a38-1a6921a0d80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:27.242306 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080525bc-21f5-46fc-9a38-1a6921a0d80e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:27.242645 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080525bc-21f5-46fc-9a38-1a6921a0d80e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:27.243050 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080525bc-21f5-46fc-9a38-1a6921a0d80e None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:27.243688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080525bc-21f5-46fc-9a38-1a6921a0d80e None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:27.243988 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080525bc-21f5-46fc-9a38-1a6921a0d80e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:27.245388 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080525bc-21f5-46fc-9a38-1a6921a0d80e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:27.256217 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 253/500] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:27.257018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080525bc-21f5-46fc-9a38-1a6921a0d80e None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:27.262562 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20d133-191e-4668-bd00-34067979dfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:27.263164 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20d133-191e-4668-bd00-34067979dfa1 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:27.263449 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20d133-191e-4668-bd00-34067979dfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:27.263729 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20d133-191e-4668-bd00-34067979dfa1 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:27.264390 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20d133-191e-4668-bd00-34067979dfa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:27.264701 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20d133-191e-4668-bd00-34067979dfa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:27.266058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20d133-191e-4668-bd00-34067979dfa1 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:27.277776 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 248/501] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:27.278591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20d133-191e-4668-bd00-34067979dfa1 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:27.315065 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:27.359569 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080525bc-21f5-46fc-9a38-1a6921a0d80e None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:27.374624 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20d133-191e-4668-bd00-34067979dfa1 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:27.392237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9abac-e38f-490c-8ced-623ded794e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:27.392879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9abac-e38f-490c-8ced-623ded794e17 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:27.393162 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9abac-e38f-490c-8ced-623ded794e17 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:27.393424 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9abac-e38f-490c-8ced-623ded794e17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:27.403796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9abac-e38f-490c-8ced-623ded794e17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:27.405285 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9abac-e38f-490c-8ced-623ded794e17 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:27.407962 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82844ee7-7e0b-4a84-b692-6e6abfabb450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:27.408587 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82844ee7-7e0b-4a84-b692-6e6abfabb450 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:27.408864 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82844ee7-7e0b-4a84-b692-6e6abfabb450 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:27.409134 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82844ee7-7e0b-4a84-b692-6e6abfabb450 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:27.409755 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82844ee7-7e0b-4a84-b692-6e6abfabb450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:27.410052 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82844ee7-7e0b-4a84-b692-6e6abfabb450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:27.411395 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82844ee7-7e0b-4a84-b692-6e6abfabb450 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:27.419824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-a0d9abac-e38f-490c-8ced-623ded794e17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:27.419824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:27.419824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:27.419824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:27.419824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:27.419824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:27.419824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:27.419824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:27.419824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:27.419824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:27.419824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:27.419824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:27.419824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:27.419824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:27.419824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:27.419824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:27.420718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:27.421543 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:27.421543 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:27.421543 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:27.421543 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 254/502] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:27.421765 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9abac-e38f-490c-8ced-623ded794e17 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:27.428702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 249/503] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:27.429603 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82844ee7-7e0b-4a84-b692-6e6abfabb450 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:27.453474 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:27.520394 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9abac-e38f-490c-8ced-623ded794e17 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:27.528059 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:27.530959 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82844ee7-7e0b-4a84-b692-6e6abfabb450 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:27.555083 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000e930-564b-47fa-a58f-4dfdc790e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:27.556251 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000e930-564b-47fa-a58f-4dfdc790e62d None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:27.556565 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000e930-564b-47fa-a58f-4dfdc790e62d None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:27.556843 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000e930-564b-47fa-a58f-4dfdc790e62d None admin] PATH_INFO: `/v3/users/glance` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:27.563435 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309ee0a-8b35-4b24-9b54-0456ae5a46fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:27.564052 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309ee0a-8b35-4b24-9b54-0456ae5a46fe None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:27.564343 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309ee0a-8b35-4b24-9b54-0456ae5a46fe None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:27.564435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000e930-564b-47fa-a58f-4dfdc790e62d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:27.564636 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309ee0a-8b35-4b24-9b54-0456ae5a46fe None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:27.565792 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000e930-564b-47fa-a58f-4dfdc790e62d None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:27.571855 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309ee0a-8b35-4b24-9b54-0456ae5a46fe None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:27.573308 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309ee0a-8b35-4b24-9b54-0456ae5a46fe None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:27.576933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-6000e930-564b-47fa-a58f-4dfdc790e62d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 20:33:27.576933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:27.576933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:27.576933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:27.576933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:27.576933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:27.576933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:27.576933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:27.576933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:27.576933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:27.576933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:27.576933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:27.576933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:33:27.576933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:33:27.576933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:33:27.576933 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:27.577834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:27.578726 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:27.578726 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:27.578726 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:33:27.578726 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:33:27.578726 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:33:27.578726 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:33:27.578726 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:33:27.578726 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:33:27.578726 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 20:33:27.578726 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:27.578726 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 255/504] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:27.578726 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000e930-564b-47fa-a58f-4dfdc790e62d None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:27.585906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-0309ee0a-8b35-4b24-9b54-0456ae5a46fe None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 20:33:27.585906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:27.585906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:27.585906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:27.585906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:27.585906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:27.585906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:27.585906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:27.585906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:27.585906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:27.585906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:27.585906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:27.585906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:33:27.585906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:33:27.585906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:33:27.585906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:27.587482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:27.588407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:27.588407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:27.588407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:33:27.588407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:33:27.588407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:33:27.588407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:33:27.588407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:33:27.588407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:33:27.588407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 20:33:27.588407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:27.588407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 250/505] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:33:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:27.588407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309ee0a-8b35-4b24-9b54-0456ae5a46fe None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:27.675527 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:27.683405 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000e930-564b-47fa-a58f-4dfdc790e62d None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:27.694336 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309ee0a-8b35-4b24-9b54-0456ae5a46fe None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:27.716543 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529011f5-8ec2-4cbf-a096-6d238e3a61fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:27.717168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529011f5-8ec2-4cbf-a096-6d238e3a61fb None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:27.717451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529011f5-8ec2-4cbf-a096-6d238e3a61fb None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:27.717725 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529011f5-8ec2-4cbf-a096-6d238e3a61fb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:27.724915 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529011f5-8ec2-4cbf-a096-6d238e3a61fb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:27.726380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529011f5-8ec2-4cbf-a096-6d238e3a61fb None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:27.727952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cf867-b0ed-46f6-a9f9-c91124f55095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:27.728512 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cf867-b0ed-46f6-a9f9-c91124f55095 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:27.728793 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cf867-b0ed-46f6-a9f9-c91124f55095 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:27.729066 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cf867-b0ed-46f6-a9f9-c91124f55095 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:27.729695 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cf867-b0ed-46f6-a9f9-c91124f55095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:27.729998 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cf867-b0ed-46f6-a9f9-c91124f55095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:27.731347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cf867-b0ed-46f6-a9f9-c91124f55095 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:27.737871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-529011f5-8ec2-4cbf-a096-6d238e3a61fb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 20:33:27.737871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:27.737871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:27.737871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:27.737871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:27.737871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:27.737871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:27.737871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:27.737871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:27.737871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:27.737871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:27.737871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:27.737871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:33:27.737871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:33:27.737871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:33:27.737871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:27.738874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:27.740320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:27.740320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:27.740320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:33:27.740320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:33:27.740320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:33:27.740320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:33:27.740320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:33:27.740320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:33:27.740320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 20:33:27.740320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:27.740320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 256/506] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:27.740320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529011f5-8ec2-4cbf-a096-6d238e3a61fb None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:27.746741 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 251/507] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:27.747544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cf867-b0ed-46f6-a9f9-c91124f55095 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:27.769433 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:27.841748 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529011f5-8ec2-4cbf-a096-6d238e3a61fb None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:27.844905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cf867-b0ed-46f6-a9f9-c91124f55095 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:27.874143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1d252-7351-48cd-bdfd-bb58b8c2ced3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:27.874738 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1d252-7351-48cd-bdfd-bb58b8c2ced3 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:27.875019 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1d252-7351-48cd-bdfd-bb58b8c2ced3 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:27.875288 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c1d252-7351-48cd-bdfd-bb58b8c2ced3 None admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:27.875996 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1d252-7351-48cd-bdfd-bb58b8c2ced3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:27.876300 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1d252-7351-48cd-bdfd-bb58b8c2ced3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:27.877749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c1d252-7351-48cd-bdfd-bb58b8c2ced3 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:27.878176 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b804960-1185-4e0d-aaa8-1b20adbdf4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:27.878777 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b804960-1185-4e0d-aaa8-1b20adbdf4da None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:27.879059 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b804960-1185-4e0d-aaa8-1b20adbdf4da None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:27.879336 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b804960-1185-4e0d-aaa8-1b20adbdf4da None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:27.880054 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b804960-1185-4e0d-aaa8-1b20adbdf4da None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:27.880392 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b804960-1185-4e0d-aaa8-1b20adbdf4da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:27.881828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b804960-1185-4e0d-aaa8-1b20adbdf4da None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:27.895101 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 257/508] 10.222.0.61 () {56 vars in 1137 bytes} [Sat Sep 24 20:33:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:27.895886 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1d252-7351-48cd-bdfd-bb58b8c2ced3 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:27.923166 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 252/509] 10.222.0.61 () {56 vars in 1139 bytes} [Sat Sep 24 20:33:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:27.923654 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:27.925522 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b804960-1185-4e0d-aaa8-1b20adbdf4da None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:27.988582 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:28.003851 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c1d252-7351-48cd-bdfd-bb58b8c2ced3 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:28.026082 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b804960-1185-4e0d-aaa8-1b20adbdf4da None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:28.037914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785b0ea-e1f7-47ea-848e-7caa8510ae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:28.038581 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785b0ea-e1f7-47ea-848e-7caa8510ae57 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:28.038806 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785b0ea-e1f7-47ea-848e-7caa8510ae57 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:28.039085 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785b0ea-e1f7-47ea-848e-7caa8510ae57 None admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:28.039845 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785b0ea-e1f7-47ea-848e-7caa8510ae57 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:28.040156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785b0ea-e1f7-47ea-848e-7caa8510ae57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:28.041898 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785b0ea-e1f7-47ea-848e-7caa8510ae57 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:28.058772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 258/510] 10.222.0.61 () {56 vars in 1137 bytes} [Sat Sep 24 20:33:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:28.059654 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785b0ea-e1f7-47ea-848e-7caa8510ae57 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:28.060712 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554f884-69ac-4e65-a7d1-0f0cd44230d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:28.061498 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554f884-69ac-4e65-a7d1-0f0cd44230d6 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:28.061946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554f884-69ac-4e65-a7d1-0f0cd44230d6 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:28.062359 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554f884-69ac-4e65-a7d1-0f0cd44230d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:28.069215 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554f884-69ac-4e65-a7d1-0f0cd44230d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:28.070828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554f884-69ac-4e65-a7d1-0f0cd44230d6 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:28.084376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-d554f884-69ac-4e65-a7d1-0f0cd44230d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:28.084376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:28.084376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:28.084376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:28.084376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:28.084376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:28.084376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:28.084376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:28.084376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:28.084376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:28.084376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:28.084376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:28.084376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:33:28.084376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:33:28.084376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:28.085394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:28.086415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:33:28.086415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:33:28.086415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:33:28.086415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:33:28.086415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:33:28.086415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:33:28.086415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:28.086415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:28.086415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 253/511] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:28.086415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554f884-69ac-4e65-a7d1-0f0cd44230d6 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:28.148727 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:28.167443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785b0ea-e1f7-47ea-848e-7caa8510ae57 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:28.193140 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554f884-69ac-4e65-a7d1-0f0cd44230d6 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:28.201335 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6892b-c4c1-481c-bf33-e82a87373a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:28.201939 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6892b-c4c1-481c-bf33-e82a87373a71 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:28.202227 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6892b-c4c1-481c-bf33-e82a87373a71 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:28.202502 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6892b-c4c1-481c-bf33-e82a87373a71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:28.214941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:28.227305 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396f5b5-f2e1-4caf-a09a-afa58d8d0056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:28.227907 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396f5b5-f2e1-4caf-a09a-afa58d8d0056 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:28.228186 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396f5b5-f2e1-4caf-a09a-afa58d8d0056 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:28.228564 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396f5b5-f2e1-4caf-a09a-afa58d8d0056 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:28.270694 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6892b-c4c1-481c-bf33-e82a87373a71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:28.272142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6892b-c4c1-481c-bf33-e82a87373a71 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:28.294972 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396f5b5-f2e1-4caf-a09a-afa58d8d0056 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:28.296446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396f5b5-f2e1-4caf-a09a-afa58d8d0056 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:28.352009 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:28.368865 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 259/512] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:28.369704 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6892b-c4c1-481c-bf33-e82a87373a71 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:28.398415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 254/513] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:28.399941 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396f5b5-f2e1-4caf-a09a-afa58d8d0056 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:28.411361 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:28.467219 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6892b-c4c1-481c-bf33-e82a87373a71 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:28.501979 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e59a8-610e-4e93-a804-b1cb095d7659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:28.502582 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e59a8-610e-4e93-a804-b1cb095d7659 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:28.502693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396f5b5-f2e1-4caf-a09a-afa58d8d0056 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:28.502867 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e59a8-610e-4e93-a804-b1cb095d7659 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:28.503139 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e59a8-610e-4e93-a804-b1cb095d7659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:28.536000 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64851d-b0ba-45c6-8677-12eab0013379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:28.536625 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64851d-b0ba-45c6-8677-12eab0013379 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:28.536905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64851d-b0ba-45c6-8677-12eab0013379 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:28.537176 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64851d-b0ba-45c6-8677-12eab0013379 None admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:28.537856 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64851d-b0ba-45c6-8677-12eab0013379 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:28.538166 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64851d-b0ba-45c6-8677-12eab0013379 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:28.539582 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64851d-b0ba-45c6-8677-12eab0013379 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:28.557459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 255/514] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:33:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:28.558252 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64851d-b0ba-45c6-8677-12eab0013379 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:28.570817 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e59a8-610e-4e93-a804-b1cb095d7659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:28.572284 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e59a8-610e-4e93-a804-b1cb095d7659 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:28.578644 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:28.613767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:28.657170 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64851d-b0ba-45c6-8677-12eab0013379 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:28.671290 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 260/515] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:28.672205 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e59a8-610e-4e93-a804-b1cb095d7659 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:28.691729 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d4cb0-4d25-462c-b876-ccda3c35a7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:28.692381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d4cb0-4d25-462c-b876-ccda3c35a7e7 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:28.692668 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d4cb0-4d25-462c-b876-ccda3c35a7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:28.692945 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d4cb0-4d25-462c-b876-ccda3c35a7e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:28.703323 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d4cb0-4d25-462c-b876-ccda3c35a7e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:28.704875 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d4cb0-4d25-462c-b876-ccda3c35a7e7 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:28.719114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-544d4cb0-4d25-462c-b876-ccda3c35a7e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:28.719114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:28.719114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:28.719114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:28.719114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:28.719114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:28.719114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:28.719114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:28.719114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:28.719114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:28.719114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:28.719114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:28.719114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:28.719114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:28.719114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:28.719114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:28.720212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:28.721497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:28.721497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:28.721497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:28.721497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 256/516] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:28.721497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d4cb0-4d25-462c-b876-ccda3c35a7e7 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:28.771655 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e59a8-610e-4e93-a804-b1cb095d7659 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:28.792096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:28.809880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19facf48-490a-4b89-b0d5-79422479332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:28.810497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19facf48-490a-4b89-b0d5-79422479332f None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:28.810777 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19facf48-490a-4b89-b0d5-79422479332f None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:28.811046 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19facf48-490a-4b89-b0d5-79422479332f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:28.820830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19facf48-490a-4b89-b0d5-79422479332f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:28.822798 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19facf48-490a-4b89-b0d5-79422479332f None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:28.823404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d4cb0-4d25-462c-b876-ccda3c35a7e7 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:28.824500 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:28.837675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-19facf48-490a-4b89-b0d5-79422479332f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:28.837675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:28.837675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:28.837675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:28.837675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:28.837675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:28.837675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:28.837675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:28.837675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:28.837675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:28.837675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:28.837675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:28.837675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:28.837675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:28.837675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:28.837675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:28.838734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:28.839604 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:28.839604 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:28.839604 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:28.839604 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 261/517] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:28.839604 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19facf48-490a-4b89-b0d5-79422479332f None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:28.862174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f5be3-e426-40e2-a8f4-595fd9b0b380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:28.862773 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f5be3-e426-40e2-a8f4-595fd9b0b380 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:28.863058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f5be3-e426-40e2-a8f4-595fd9b0b380 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:28.863328 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f5be3-e426-40e2-a8f4-595fd9b0b380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:28.864044 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f5be3-e426-40e2-a8f4-595fd9b0b380 None admin] RBAC: Adding query filter params (role.id=6e079191d798481b811c5c8dca0c0f7a, scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341, user.id=bc96ad30b91b46af92ff5b27a6b83abd) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:28.864386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f5be3-e426-40e2-a8f4-595fd9b0b380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:28.865805 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f5be3-e426-40e2-a8f4-595fd9b0b380 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:28.871076 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 257/518] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:33:28 2022] GET /identity/v3/role_assignments?user.id=bc96ad30b91b46af92ff5b27a6b83abd&scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341&role.id=6e079191d798481b811c5c8dca0c0f7a => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:28.871843 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f5be3-e426-40e2-a8f4-595fd9b0b380 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:28.952904 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19facf48-490a-4b89-b0d5-79422479332f None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:28.993543 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead058c0-5e8f-4446-b4f2-fda24681db2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:28.994250 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead058c0-5e8f-4446-b4f2-fda24681db2a None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:28.994466 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead058c0-5e8f-4446-b4f2-fda24681db2a None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:28.994741 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead058c0-5e8f-4446-b4f2-fda24681db2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:28.999359 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f5be3-e426-40e2-a8f4-595fd9b0b380 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:29.006532 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead058c0-5e8f-4446-b4f2-fda24681db2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:29.008015 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead058c0-5e8f-4446-b4f2-fda24681db2a None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:29.024901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-ead058c0-5e8f-4446-b4f2-fda24681db2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:29.024901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:29.024901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:29.024901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:29.024901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:29.024901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:29.024901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:29.024901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:29.024901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:29.024901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:29.024901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:29.024901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:29.024901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:29.024901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:29.024901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:29.024901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:29.025897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:29.026747 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:29.026747 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:29.026747 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:29.026747 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 262/519] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:29.026979 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead058c0-5e8f-4446-b4f2-fda24681db2a None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:29.044395 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8154d1-8957-4262-85ae-11bb82aa522c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:29.045033 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8154d1-8957-4262-85ae-11bb82aa522c None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:29.045315 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8154d1-8957-4262-85ae-11bb82aa522c None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:29.045595 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8154d1-8957-4262-85ae-11bb82aa522c None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:29.046259 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8154d1-8957-4262-85ae-11bb82aa522c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:29.046569 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8154d1-8957-4262-85ae-11bb82aa522c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:29.048005 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8154d1-8957-4262-85ae-11bb82aa522c None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:29.050981 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:29.065777 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 258/520] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:29.066804 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8154d1-8957-4262-85ae-11bb82aa522c None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:29.086039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:29.158440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead058c0-5e8f-4446-b4f2-fda24681db2a None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:29.183182 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8154d1-8957-4262-85ae-11bb82aa522c None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:29.198832 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3da0c-3280-40a0-9b99-12cd7709a445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:29.199435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3da0c-3280-40a0-9b99-12cd7709a445 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:29.199715 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3da0c-3280-40a0-9b99-12cd7709a445 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:29.199989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3da0c-3280-40a0-9b99-12cd7709a445 None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:29.200666 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3da0c-3280-40a0-9b99-12cd7709a445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:29.200969 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3da0c-3280-40a0-9b99-12cd7709a445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:29.202348 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3da0c-3280-40a0-9b99-12cd7709a445 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:29.213963 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 263/521] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:29.214697 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3da0c-3280-40a0-9b99-12cd7709a445 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:29.225907 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda31bb-5d74-48bc-a627-c561ab6c091b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:29.226849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda31bb-5d74-48bc-a627-c561ab6c091b None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:29.227343 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda31bb-5d74-48bc-a627-c561ab6c091b None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:29.227894 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda31bb-5d74-48bc-a627-c561ab6c091b None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:29.228829 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda31bb-5d74-48bc-a627-c561ab6c091b None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:29.229302 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda31bb-5d74-48bc-a627-c561ab6c091b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:29.230909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda31bb-5d74-48bc-a627-c561ab6c091b None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:29.244965 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 259/522] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:29.246114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda31bb-5d74-48bc-a627-c561ab6c091b None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:29.309158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:29.325731 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3da0c-3280-40a0-9b99-12cd7709a445 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:29.333056 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:29.358597 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda31bb-5d74-48bc-a627-c561ab6c091b None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:29.360901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9a8bd-f1b8-4800-a433-2dae6b3e9ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:29.361523 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9a8bd-f1b8-4800-a433-2dae6b3e9ea5 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:29.361803 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9a8bd-f1b8-4800-a433-2dae6b3e9ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:29.362075 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9a8bd-f1b8-4800-a433-2dae6b3e9ea5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:29.368773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9a8bd-f1b8-4800-a433-2dae6b3e9ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:29.370215 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9a8bd-f1b8-4800-a433-2dae6b3e9ea5 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:29.381879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-f0f9a8bd-f1b8-4800-a433-2dae6b3e9ea5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:29.381879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:29.381879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:29.381879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:29.381879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:29.381879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:29.381879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:29.381879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:29.381879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:29.381879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:29.381879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:29.381879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:29.381879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:33:29.381879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:33:29.381879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:29.382722 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:29.384097 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:33:29.384097 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:33:29.384097 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:33:29.384097 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:33:29.384097 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:33:29.384097 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:33:29.384097 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:29.384097 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:29.384097 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 264/523] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:29.385049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9a8bd-f1b8-4800-a433-2dae6b3e9ea5 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:29.403831 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb72608-509d-4800-9959-9b918cd1a877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:29.404510 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb72608-509d-4800-9959-9b918cd1a877 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:29.404802 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb72608-509d-4800-9959-9b918cd1a877 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:29.405078 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb72608-509d-4800-9959-9b918cd1a877 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:29.412211 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb72608-509d-4800-9959-9b918cd1a877 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:29.413689 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb72608-509d-4800-9959-9b918cd1a877 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:29.426214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-3eb72608-509d-4800-9959-9b918cd1a877 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:29.426214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:29.426214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:29.426214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:29.426214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:29.426214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:29.426214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:29.426214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:29.426214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:29.426214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:29.426214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:29.426214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:29.426214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:33:29.426214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:33:29.426214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:29.427220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:29.428067 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:33:29.428067 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:33:29.428067 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:33:29.428067 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:33:29.428067 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:33:29.428067 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:33:29.428067 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:29.428067 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:29.432117 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 260/524] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:29.433036 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb72608-509d-4800-9959-9b918cd1a877 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:29.504621 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9a8bd-f1b8-4800-a433-2dae6b3e9ea5 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:29.539334 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb72608-509d-4800-9959-9b918cd1a877 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:29.540450 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994c926-c71c-4469-a68a-9f14515fb051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:29.541072 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994c926-c71c-4469-a68a-9f14515fb051 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:29.541605 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994c926-c71c-4469-a68a-9f14515fb051 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:29.542569 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994c926-c71c-4469-a68a-9f14515fb051 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:29.548439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994c926-c71c-4469-a68a-9f14515fb051 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:29.549875 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994c926-c71c-4469-a68a-9f14515fb051 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:29.558045 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:29.561796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-d994c926-c71c-4469-a68a-9f14515fb051 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:29.561796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:29.561796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:29.561796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:29.561796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:29.561796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:29.561796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:29.561796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:29.561796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:29.561796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:29.561796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:29.561796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:29.561796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:33:29.561796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:33:29.561796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:29.563049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:29.565030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:33:29.565030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:33:29.565030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:33:29.565030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:33:29.565030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:33:29.565030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:33:29.565030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:29.565030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:29.567865 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 265/525] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:29.568805 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994c926-c71c-4469-a68a-9f14515fb051 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:29.582941 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574fb65-3d22-4402-a515-23ebb6e648aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:29.583561 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574fb65-3d22-4402-a515-23ebb6e648aa None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:29.583846 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574fb65-3d22-4402-a515-23ebb6e648aa None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:29.584124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574fb65-3d22-4402-a515-23ebb6e648aa None admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:29.584853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574fb65-3d22-4402-a515-23ebb6e648aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:29.585172 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574fb65-3d22-4402-a515-23ebb6e648aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:29.587199 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574fb65-3d22-4402-a515-23ebb6e648aa None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:29.604040 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 261/526] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:33:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:29.605062 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574fb65-3d22-4402-a515-23ebb6e648aa None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:29.609638 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:29.692249 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994c926-c71c-4469-a68a-9f14515fb051 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:29.714922 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574fb65-3d22-4402-a515-23ebb6e648aa None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:29.728090 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeb437-8df6-4948-8d32-6779f38e102d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:29.728751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeb437-8df6-4948-8d32-6779f38e102d None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:29.729030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeb437-8df6-4948-8d32-6779f38e102d None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:29.729300 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeb437-8df6-4948-8d32-6779f38e102d None admin] PATH_INFO: `/v3/projects` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:29.730008 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efeb437-8df6-4948-8d32-6779f38e102d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:29.730289 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efeb437-8df6-4948-8d32-6779f38e102d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:29.731711 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efeb437-8df6-4948-8d32-6779f38e102d None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:29.754519 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 266/527] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:33:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:29.754747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff54cf-bf92-4d09-a3f6-440cf0890059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:29.754853 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeb437-8df6-4948-8d32-6779f38e102d None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:29.754935 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff54cf-bf92-4d09-a3f6-440cf0890059 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:29.754935 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff54cf-bf92-4d09-a3f6-440cf0890059 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:29.754935 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff54cf-bf92-4d09-a3f6-440cf0890059 None admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:29.754935 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff54cf-bf92-4d09-a3f6-440cf0890059 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:29.754935 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff54cf-bf92-4d09-a3f6-440cf0890059 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:29.754935 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff54cf-bf92-4d09-a3f6-440cf0890059 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:29.766135 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 262/528] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:33:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:29.766936 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff54cf-bf92-4d09-a3f6-440cf0890059 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:29.803812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:29.850425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:29.867615 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeb437-8df6-4948-8d32-6779f38e102d None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:29.871852 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff54cf-bf92-4d09-a3f6-440cf0890059 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:29.907516 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383a186-5f17-4266-a3e0-d4f721ceb551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:29.907973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93f33f-74f9-49b7-b0b9-53a0769ab041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:29.908096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383a186-5f17-4266-a3e0-d4f721ceb551 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:29.908407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383a186-5f17-4266-a3e0-d4f721ceb551 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:29.908687 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383a186-5f17-4266-a3e0-d4f721ceb551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:29.912373 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383a186-5f17-4266-a3e0-d4f721ceb551 None admin] RBAC: Adding query filter params (role.id=6e079191d798481b811c5c8dca0c0f7a, scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341, user.id=0e97928ca3294ebdbc53468d84c64b26) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:29.912373 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383a186-5f17-4266-a3e0-d4f721ceb551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:29.912373 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383a186-5f17-4266-a3e0-d4f721ceb551 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:29.913171 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93f33f-74f9-49b7-b0b9-53a0769ab041 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:29.913465 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93f33f-74f9-49b7-b0b9-53a0769ab041 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:29.913745 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93f33f-74f9-49b7-b0b9-53a0769ab041 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:29.914478 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93f33f-74f9-49b7-b0b9-53a0769ab041 None admin] RBAC: Adding query filter params (role.id=6e079191d798481b811c5c8dca0c0f7a, scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341, user.id=b505bdb933aa4bffa870851e4cb87c59) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:29.915363 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93f33f-74f9-49b7-b0b9-53a0769ab041 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:29.917147 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93f33f-74f9-49b7-b0b9-53a0769ab041 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:29.920900 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 263/529] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:33:29 2022] GET /identity/v3/role_assignments?user.id=0e97928ca3294ebdbc53468d84c64b26&scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341&role.id=6e079191d798481b811c5c8dca0c0f7a => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:29.923658 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383a186-5f17-4266-a3e0-d4f721ceb551 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:29.927266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 267/530] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:33:29 2022] GET /identity/v3/role_assignments?user.id=b505bdb933aa4bffa870851e4cb87c59&scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341&role.id=6e079191d798481b811c5c8dca0c0f7a => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:30.066045 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:30.071237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383a186-5f17-4266-a3e0-d4f721ceb551 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:30.115741 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a1da8-9c25-459f-a741-845fb1525684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:30.116856 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a1da8-9c25-459f-a741-845fb1525684 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:30.117356 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a1da8-9c25-459f-a741-845fb1525684 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:30.117888 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a1da8-9c25-459f-a741-845fb1525684 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:30.118876 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a1da8-9c25-459f-a741-845fb1525684 None admin] RBAC: Adding query filter params (role.id=6e079191d798481b811c5c8dca0c0f7a, scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341, user.id=9e6e1fa10cb9487d8b346800e360c7a2) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:30.119574 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a1da8-9c25-459f-a741-845fb1525684 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:30.121319 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a1da8-9c25-459f-a741-845fb1525684 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:30.128585 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 264/531] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:33:29 2022] GET /identity/v3/role_assignments?user.id=9e6e1fa10cb9487d8b346800e360c7a2&scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341&role.id=6e079191d798481b811c5c8dca0c0f7a => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:31.326127 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed8e0a-ed08-4e95-883b-6c5b6bd997b2 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:31.326636 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed8e0a-ed08-4e95-883b-6c5b6bd997b2 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:31.326745 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed8e0a-ed08-4e95-883b-6c5b6bd997b2 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:31.328228 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 268/532] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:31.333777 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadccf47-e110-4cbc-91a4-aa1b20edbd4b None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:31.334234 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadccf47-e110-4cbc-91a4-aa1b20edbd4b None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:31.334316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadccf47-e110-4cbc-91a4-aa1b20edbd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:31.353517 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-aadccf47-e110-4cbc-91a4-aa1b20edbd4b None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:31.354709 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-aadccf47-e110-4cbc-91a4-aa1b20edbd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:31.424866 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 265/533] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:31.749764 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed8e0a-ed08-4e95-883b-6c5b6bd997b2 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:31.858610 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed8e0a-ed08-4e95-883b-6c5b6bd997b2 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:31.893421 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0cc4e-7fd7-4039-a9df-1d918493e5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:31.894047 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0cc4e-7fd7-4039-a9df-1d918493e5b2 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:31.894329 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0cc4e-7fd7-4039-a9df-1d918493e5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:31.894605 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0cc4e-7fd7-4039-a9df-1d918493e5b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:31.905275 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0cc4e-7fd7-4039-a9df-1d918493e5b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:31.910409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-44b0cc4e-7fd7-4039-a9df-1d918493e5b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:31.910409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:31.910409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:31.910409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:31.910409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:31.910409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:31.910409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:31.910409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:31.910409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:31.910409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:31.910409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:31.910409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:31.910409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:31.910409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:31.910409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:31.910409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:31.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:31.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:31.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:31.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:31.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:31.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:31.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:31.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:31.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:31.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:31.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:31.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:31.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:31.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:31.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:31.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:31.914281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:31.914281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:31.914281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:31.914281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:31.914281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:31.914281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:31.914281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:31.914281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:31.914281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:31.914281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:31.914281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:31.914281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:31.914281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 269/534] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:33:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:31.921696 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadccf47-e110-4cbc-91a4-aa1b20edbd4b None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:32.040438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadccf47-e110-4cbc-91a4-aa1b20edbd4b None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:32.042215 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:32.077671 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ef134-a986-42c1-bbc1-e360fa6c0c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:32.078286 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ef134-a986-42c1-bbc1-e360fa6c0c62 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:32.078565 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ef134-a986-42c1-bbc1-e360fa6c0c62 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:32.078839 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ef134-a986-42c1-bbc1-e360fa6c0c62 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:32.079511 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ef134-a986-42c1-bbc1-e360fa6c0c62 None admin] RBAC: Adding query filter params (name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:32.079815 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ef134-a986-42c1-bbc1-e360fa6c0c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:32.081210 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ef134-a986-42c1-bbc1-e360fa6c0c62 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:32.090468 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 266/535] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Sep 24 20:33:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:32.096067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0cc4e-7fd7-4039-a9df-1d918493e5b2 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:32.117970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:32.221774 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0cc4e-7fd7-4039-a9df-1d918493e5b2 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:32.259421 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c5303-a12b-4672-b53b-10d4951c7527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:32.260369 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c5303-a12b-4672-b53b-10d4951c7527 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:32.260894 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c5303-a12b-4672-b53b-10d4951c7527 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:32.261362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c5303-a12b-4672-b53b-10d4951c7527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:32.274768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c5303-a12b-4672-b53b-10d4951c7527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:32.276635 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c5303-a12b-4672-b53b-10d4951c7527 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:32.292224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-5e4c5303-a12b-4672-b53b-10d4951c7527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:32.292224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:32.292224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:32.292224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:32.292224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:32.292224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:32.292224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:32.292224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:32.292224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:32.292224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:32.292224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:32.292224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:32.292224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:32.292224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:32.292224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:32.292224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:32.293157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:32.293988 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:32.293988 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:32.293988 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:32.295854 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 270/536] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:32.301471 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ef134-a986-42c1-bbc1-e360fa6c0c62 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:32.407336 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ef134-a986-42c1-bbc1-e360fa6c0c62 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:32.430549 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d56b5-b24d-4210-9b83-20769bfb9221 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:32.431074 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d56b5-b24d-4210-9b83-20769bfb9221 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:32.431074 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d56b5-b24d-4210-9b83-20769bfb9221 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:32.432679 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 271/537] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:32.437552 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe17c6-6720-4096-9f4f-5abc5d82ca57 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:32.437836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe17c6-6720-4096-9f4f-5abc5d82ca57 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:32.438114 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe17c6-6720-4096-9f4f-5abc5d82ca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:32.444537 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52477651-363a-4873-a165-ab0db4e60910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:32.445150 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52477651-363a-4873-a165-ab0db4e60910 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:32.445434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52477651-363a-4873-a165-ab0db4e60910 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:32.445713 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52477651-363a-4873-a165-ab0db4e60910 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:32.446982 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52477651-363a-4873-a165-ab0db4e60910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:32.447295 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52477651-363a-4873-a165-ab0db4e60910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:32.448822 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52477651-363a-4873-a165-ab0db4e60910 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:32.460293 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-0afe17c6-6720-4096-9f4f-5abc5d82ca57 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:32.461941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-0afe17c6-6720-4096-9f4f-5abc5d82ca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:32.462243 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 267/538] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:32.468575 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52477651-363a-4873-a165-ab0db4e60910 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:32.491818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:32.529937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:32.552197 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 272/539] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:32.552197 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6b02c-29b7-4ef5-9e74-e587283f8f5b None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:32.552197 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6b02c-29b7-4ef5-9e74-e587283f8f5b None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:32.552197 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6b02c-29b7-4ef5-9e74-e587283f8f5b None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:32.552197 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 273/540] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:32.555005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04509cb0-453b-49fb-bba2-199d24d56ceb None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:32.555319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04509cb0-453b-49fb-bba2-199d24d56ceb None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:32.555600 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04509cb0-453b-49fb-bba2-199d24d56ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:32.579452 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-04509cb0-453b-49fb-bba2-199d24d56ceb None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:32.580942 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-04509cb0-453b-49fb-bba2-199d24d56ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:32.585098 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52477651-363a-4873-a165-ab0db4e60910 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:32.622223 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d56401-9123-48f9-8f63-6132471ff8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:32.623590 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d56401-9123-48f9-8f63-6132471ff8f2 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:32.623590 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d56401-9123-48f9-8f63-6132471ff8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:32.623590 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d56401-9123-48f9-8f63-6132471ff8f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:32.630778 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d56401-9123-48f9-8f63-6132471ff8f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:32.632386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d56401-9123-48f9-8f63-6132471ff8f2 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:32.644376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-d1d56401-9123-48f9-8f63-6132471ff8f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 20:33:32.644376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:32.644376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:32.644376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:32.644376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:32.644376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:32.644376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:32.644376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:32.644376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:32.644376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:32.644376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:32.644376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:32.644376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:33:32.644376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:33:32.644376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:33:32.644376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:32.645271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:32.646246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:32.646246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:32.646246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:33:32.646246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:33:32.646246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:33:32.646246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:33:32.646246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:33:32.646246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:33:32.646246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 20:33:32.646246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:32.646246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 268/541] 10.222.0.61 () {56 vars in 1093 bytes} [Sat Sep 24 20:33:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:33:32.646840 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716b380-c77e-4f35-a8d6-57fd86da6a6a None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:32.646840 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716b380-c77e-4f35-a8d6-57fd86da6a6a None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:32.647460 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716b380-c77e-4f35-a8d6-57fd86da6a6a None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:32.648570 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 269/542] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:32.651481 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716b380-c77e-4f35-a8d6-57fd86da6a6a None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:32.663090 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 274/543] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:33:32.668810 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca5d99-ae57-4e14-a2a1-a1fd35ecf062 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:32.668810 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca5d99-ae57-4e14-a2a1-a1fd35ecf062 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:32.668810 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca5d99-ae57-4e14-a2a1-a1fd35ecf062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:32.690010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-c5ca5d99-ae57-4e14-a2a1-a1fd35ecf062 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:32.692297 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-c5ca5d99-ae57-4e14-a2a1-a1fd35ecf062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:32.748013 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:32.779441 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716b380-c77e-4f35-a8d6-57fd86da6a6a None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:32.788384 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 275/544] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:32.821961 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbf8fa-f80d-4bf1-b8b8-80aefdf48b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:32.822816 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbf8fa-f80d-4bf1-b8b8-80aefdf48b36 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:32.823274 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbf8fa-f80d-4bf1-b8b8-80aefdf48b36 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:32.823756 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbf8fa-f80d-4bf1-b8b8-80aefdf48b36 None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:32.824829 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbf8fa-f80d-4bf1-b8b8-80aefdf48b36 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:32.825332 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbf8fa-f80d-4bf1-b8b8-80aefdf48b36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:32.826917 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbf8fa-f80d-4bf1-b8b8-80aefdf48b36 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:32.845876 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 270/545] 10.222.0.61 () {56 vars in 1133 bytes} [Sat Sep 24 20:33:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:32.851700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca5d99-ae57-4e14-a2a1-a1fd35ecf062 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:32.898071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbf8fa-f80d-4bf1-b8b8-80aefdf48b36 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:32.909818 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:32.973087 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca5d99-ae57-4e14-a2a1-a1fd35ecf062 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:33.014924 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34b7fc-5fd8-49b2-83bc-61844da19cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:33.015553 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34b7fc-5fd8-49b2-83bc-61844da19cd5 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:33.015838 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34b7fc-5fd8-49b2-83bc-61844da19cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:33.016114 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34b7fc-5fd8-49b2-83bc-61844da19cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:33.016678 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbf8fa-f80d-4bf1-b8b8-80aefdf48b36 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:33.026753 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34b7fc-5fd8-49b2-83bc-61844da19cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:33.028213 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34b7fc-5fd8-49b2-83bc-61844da19cd5 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:33.043264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-ea34b7fc-5fd8-49b2-83bc-61844da19cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:33.043264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:33.043264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:33.043264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:33.043264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:33.043264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:33.043264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:33.043264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:33.043264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:33.043264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:33.043264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:33.043264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:33.043264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:33.043264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:33.043264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:33.043264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:33.044168 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:33.045085 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:33.045085 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:33.045085 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:33.045085 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 276/546] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:33.046099 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34b7fc-5fd8-49b2-83bc-61844da19cd5 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:33.054151 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71002e5-d528-40dc-b358-fea43aeea4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:33.054780 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71002e5-d528-40dc-b358-fea43aeea4a6 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:33.055569 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71002e5-d528-40dc-b358-fea43aeea4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:33.055853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71002e5-d528-40dc-b358-fea43aeea4a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:33.058661 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:33.069515 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71002e5-d528-40dc-b358-fea43aeea4a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:33.074818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-f71002e5-d528-40dc-b358-fea43aeea4a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:33.074818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:33.074818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:33.074818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:33.074818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:33.074818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:33.074818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:33.074818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:33.074818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:33.074818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:33.074818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:33.074818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:33.074818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:33.074818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:33.074818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:33.074818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:33.075670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:33.075670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:33.075670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:33.075670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:33.075670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:33.075670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:33.075670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:33.075670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:33.075670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:33.075670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:33.075670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:33.075670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:33.075670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:33.075670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:33.075670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:33.075670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:33.076898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:33.076898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:33.076898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:33.076898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:33.076898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:33.076898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:33.076898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:33.076898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:33.076898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:33.076898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:33.076898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:33.076898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:33.076898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 271/547] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:33:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:33.076898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71002e5-d528-40dc-b358-fea43aeea4a6 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:33.156747 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34b7fc-5fd8-49b2-83bc-61844da19cd5 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:33.160058 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:33.187224 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71002e5-d528-40dc-b358-fea43aeea4a6 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:33.193545 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f7440-2720-464a-aea7-ade075087489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:33.194177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7440-2720-464a-aea7-ade075087489 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:33.194460 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7440-2720-464a-aea7-ade075087489 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:33.194737 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7440-2720-464a-aea7-ade075087489 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:33.205278 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f7440-2720-464a-aea7-ade075087489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:33.210401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-436f7440-2720-464a-aea7-ade075087489 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:33.210401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:33.210401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:33.210401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:33.210401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:33.210401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:33.210401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:33.210401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:33.210401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:33.210401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:33.210401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:33.210401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:33.210401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:33.210401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:33.210401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:33.210401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:33.212270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:33.212270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:33.212270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:33.212270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:33.212270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:33.212270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:33.212270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:33.212270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:33.212270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:33.212270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:33.212270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:33.212270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:33.212270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:33.212270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:33.212270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:33.212270 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:33.213101 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:33.213101 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:33.213101 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:33.213101 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:33.213101 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:33.213101 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:33.213101 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:33.213101 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:33.213101 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:33.213101 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:33.213101 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:33.213101 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:33.213101 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 277/548] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:33:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:33.213750 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f7440-2720-464a-aea7-ade075087489 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:33.225793 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f1371-7f35-41c6-9214-b0b8d4e68f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:33.226396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f1371-7f35-41c6-9214-b0b8d4e68f75 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:33.226678 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f1371-7f35-41c6-9214-b0b8d4e68f75 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:33.226958 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f1371-7f35-41c6-9214-b0b8d4e68f75 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:33.227767 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f1371-7f35-41c6-9214-b0b8d4e68f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:33.228473 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f1371-7f35-41c6-9214-b0b8d4e68f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:33.229874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f1371-7f35-41c6-9214-b0b8d4e68f75 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:33.241098 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 272/549] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:33.241875 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f1371-7f35-41c6-9214-b0b8d4e68f75 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:33.297623 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:33.313186 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f7440-2720-464a-aea7-ade075087489 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:33.341362 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f1371-7f35-41c6-9214-b0b8d4e68f75 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:33.346833 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b717dd-2abf-4336-9928-95b071f498c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:33.347427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b717dd-2abf-4336-9928-95b071f498c1 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:33.347705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b717dd-2abf-4336-9928-95b071f498c1 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:33.348391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b717dd-2abf-4336-9928-95b071f498c1 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:33.349046 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b717dd-2abf-4336-9928-95b071f498c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:33.349348 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b717dd-2abf-4336-9928-95b071f498c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:33.350698 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b717dd-2abf-4336-9928-95b071f498c1 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:33.358420 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 278/550] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Sep 24 20:33:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:33.359222 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b717dd-2abf-4336-9928-95b071f498c1 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:33.382696 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b96bfa-97b4-46ce-861a-7d346609155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:33.383855 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96bfa-97b4-46ce-861a-7d346609155c None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:33.384134 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96bfa-97b4-46ce-861a-7d346609155c None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:33.384436 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b96bfa-97b4-46ce-861a-7d346609155c None admin] PATH_INFO: `/v3/roles/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:33.389529 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:33.394508 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b96bfa-97b4-46ce-861a-7d346609155c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:33.400297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-76b96bfa-97b4-46ce-861a-7d346609155c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:33.400297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:33.400297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:33.400297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:33.400297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:33.400297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:33.400297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:33.400297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:33.400297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:33.400297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:33.400297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:33.400297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:33.400297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:33.400297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:33.400297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:33.400297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:33.401398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:33.401398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:33.401398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:33.401398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:33.401398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:33.401398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:33.401398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:33.401398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:33.401398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:33.401398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:33.401398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:33.401398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:33.401398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:33.401398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:33.401398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:33.401398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:33.402740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:33.402740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:33.402740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:33.402740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:33.402740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:33.402740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:33.402740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:33.402740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:33.402740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:33.402740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:33.402740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:33.402740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:33.402740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 273/551] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:33:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:33.402740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b96bfa-97b4-46ce-861a-7d346609155c None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:33.464587 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b717dd-2abf-4336-9928-95b071f498c1 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:33.502675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b69ee-f2b1-4252-8e1c-3570212be01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:33.503370 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b69ee-f2b1-4252-8e1c-3570212be01f None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:33.503654 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b69ee-f2b1-4252-8e1c-3570212be01f None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:33.503927 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b69ee-f2b1-4252-8e1c-3570212be01f None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:33.504613 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b69ee-f2b1-4252-8e1c-3570212be01f None admin] RBAC: Adding query filter params (name=service) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:33.504918 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b69ee-f2b1-4252-8e1c-3570212be01f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:33.505318 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b96bfa-97b4-46ce-861a-7d346609155c None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:33.506279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b69ee-f2b1-4252-8e1c-3570212be01f None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:33.515319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 279/552] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Sep 24 20:33:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:33.516115 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b69ee-f2b1-4252-8e1c-3570212be01f None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:33.523594 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:33.545284 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726f091-6230-475e-a7bc-a7dd84445c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:33.545902 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726f091-6230-475e-a7bc-a7dd84445c2b None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:33.546181 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726f091-6230-475e-a7bc-a7dd84445c2b None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:33.546455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726f091-6230-475e-a7bc-a7dd84445c2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:33.552924 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726f091-6230-475e-a7bc-a7dd84445c2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:33.554464 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726f091-6230-475e-a7bc-a7dd84445c2b None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:33.565912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-0726f091-6230-475e-a7bc-a7dd84445c2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:33.565912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:33.565912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:33.565912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:33.565912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:33.565912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:33.565912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:33.565912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:33.565912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:33.565912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:33.565912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:33.565912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:33.565912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:33:33.565912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:33:33.565912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:33.566758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:33.567641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:33:33.567641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:33:33.567641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:33:33.567641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:33:33.567641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:33:33.567641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:33:33.567641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:33.567641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:33.567641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 274/553] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:33.568484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726f091-6230-475e-a7bc-a7dd84445c2b None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:33.607550 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:33.619510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b69ee-f2b1-4252-8e1c-3570212be01f None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:33.652027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b808e40-e344-46ab-a597-b0ac38ff9153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:33.652690 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b808e40-e344-46ab-a597-b0ac38ff9153 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:33.652970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b808e40-e344-46ab-a597-b0ac38ff9153 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:33.653253 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b808e40-e344-46ab-a597-b0ac38ff9153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:33.663747 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b808e40-e344-46ab-a597-b0ac38ff9153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:33.665809 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b808e40-e344-46ab-a597-b0ac38ff9153 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:33.668792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726f091-6230-475e-a7bc-a7dd84445c2b None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:33.679682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-6b808e40-e344-46ab-a597-b0ac38ff9153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:33.679682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:33.679682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:33.679682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:33.679682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:33.679682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:33.679682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:33.679682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:33.679682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:33.679682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:33.679682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:33.679682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:33.679682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:33.679682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:33.679682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:33.679682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:33.680743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:33.681610 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:33.681610 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:33.681610 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:33.681610 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 280/554] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:33.681610 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b808e40-e344-46ab-a597-b0ac38ff9153 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:33.704712 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9627d-bd59-4b06-9205-cb6097e1eb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:33.705313 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9627d-bd59-4b06-9205-cb6097e1eb23 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:33.705593 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9627d-bd59-4b06-9205-cb6097e1eb23 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:33.705866 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9627d-bd59-4b06-9205-cb6097e1eb23 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:33.706516 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9627d-bd59-4b06-9205-cb6097e1eb23 None admin] RBAC: Adding query filter params (name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:33.706819 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9627d-bd59-4b06-9205-cb6097e1eb23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:33.708179 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9627d-bd59-4b06-9205-cb6097e1eb23 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:33.716438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 275/555] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Sep 24 20:33:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:33.717474 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9627d-bd59-4b06-9205-cb6097e1eb23 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:33.753418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:33.787329 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b808e40-e344-46ab-a597-b0ac38ff9153 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:33.819219 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9627d-bd59-4b06-9205-cb6097e1eb23 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:33.821583 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f354cfb-8b28-47b4-a85a-35562bbee08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:33.822207 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f354cfb-8b28-47b4-a85a-35562bbee08b None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:33.822487 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f354cfb-8b28-47b4-a85a-35562bbee08b None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:33.822759 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f354cfb-8b28-47b4-a85a-35562bbee08b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:33.831222 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:33.833663 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f354cfb-8b28-47b4-a85a-35562bbee08b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:33.835403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f354cfb-8b28-47b4-a85a-35562bbee08b None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:33.850241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-4f354cfb-8b28-47b4-a85a-35562bbee08b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:33.850241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:33.850241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:33.850241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:33.850241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:33.850241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:33.850241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:33.850241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:33.850241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:33.850241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:33.850241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:33.850241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:33.850241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:33.850241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:33.850241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:33.850241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:33.851295 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:33.852866 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:33.852866 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:33.852866 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:33.852866 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 281/556] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:33.852866 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f354cfb-8b28-47b4-a85a-35562bbee08b None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:33.854285 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e449b3-181f-4ea0-9aec-fa325cfba83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:33.854896 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e449b3-181f-4ea0-9aec-fa325cfba83d None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:33.855355 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e449b3-181f-4ea0-9aec-fa325cfba83d None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:33.855632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e449b3-181f-4ea0-9aec-fa325cfba83d None admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:33.857077 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e449b3-181f-4ea0-9aec-fa325cfba83d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:33.857391 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e449b3-181f-4ea0-9aec-fa325cfba83d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:33.858872 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e449b3-181f-4ea0-9aec-fa325cfba83d None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:33.871001 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 276/557] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:33:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:33.872068 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e449b3-181f-4ea0-9aec-fa325cfba83d None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:33.957625 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f354cfb-8b28-47b4-a85a-35562bbee08b None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:33.965304 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:33.972368 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e449b3-181f-4ea0-9aec-fa325cfba83d None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:33.990646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9db45-0fe0-4a37-bcf5-9923f557080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:33.991237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9db45-0fe0-4a37-bcf5-9923f557080a None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:33.991599 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9db45-0fe0-4a37-bcf5-9923f557080a None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:33.991880 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9db45-0fe0-4a37-bcf5-9923f557080a None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:33.992555 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9db45-0fe0-4a37-bcf5-9923f557080a None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:33.992858 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9db45-0fe0-4a37-bcf5-9923f557080a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:33.994211 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9db45-0fe0-4a37-bcf5-9923f557080a None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:34.005739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f127ed-5f6a-4055-a8b8-9f859c1554c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:34.005889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 282/558] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:34.006360 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f127ed-5f6a-4055-a8b8-9f859c1554c6 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:34.006646 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f127ed-5f6a-4055-a8b8-9f859c1554c6 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:34.006857 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9db45-0fe0-4a37-bcf5-9923f557080a None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:34.006963 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f127ed-5f6a-4055-a8b8-9f859c1554c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:34.017892 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f127ed-5f6a-4055-a8b8-9f859c1554c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:34.019358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f127ed-5f6a-4055-a8b8-9f859c1554c6 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:34.034909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-50f127ed-5f6a-4055-a8b8-9f859c1554c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:34.034909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:34.034909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:34.034909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:34.034909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:34.034909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:34.034909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:34.034909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:34.034909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:34.034909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:34.034909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:34.034909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:34.034909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:34.034909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:34.034909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:34.034909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:34.035849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:34.036768 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:34.036768 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:34.036768 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:34.036768 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 277/559] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:34.037199 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f127ed-5f6a-4055-a8b8-9f859c1554c6 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:34.067003 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:34.116290 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9db45-0fe0-4a37-bcf5-9923f557080a None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:34.139142 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f127ed-5f6a-4055-a8b8-9f859c1554c6 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:34.150501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8c1a3-4805-4364-ac62-1f43bc67dcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:34.151156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8c1a3-4805-4364-ac62-1f43bc67dcce None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:34.151439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8c1a3-4805-4364-ac62-1f43bc67dcce None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:34.151712 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8c1a3-4805-4364-ac62-1f43bc67dcce None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:34.152382 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8c1a3-4805-4364-ac62-1f43bc67dcce None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:34.152682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8c1a3-4805-4364-ac62-1f43bc67dcce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:34.154035 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8c1a3-4805-4364-ac62-1f43bc67dcce None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:34.167532 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 283/560] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:34.168386 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8c1a3-4805-4364-ac62-1f43bc67dcce None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:34.173351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9b3ba-4765-46ee-908e-6a6284f33708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:34.174013 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9b3ba-4765-46ee-908e-6a6284f33708 None admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:34.174296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9b3ba-4765-46ee-908e-6a6284f33708 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:34.174581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9b3ba-4765-46ee-908e-6a6284f33708 None admin] PATH_INFO: `/v3/projects/6e446dc5c12d49bca59e6e8c8ad90341/users/bc96ad30b91b46af92ff5b27a6b83abd/roles/6e079191d798481b811c5c8dca0c0f7a` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:34.188721 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9b3ba-4765-46ee-908e-6a6284f33708 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e446dc5c12d49bca59e6e8c8ad90341, user_id=bc96ad30b91b46af92ff5b27a6b83abd, role_id=6e079191d798481b811c5c8dca0c0f7a)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:34.190140 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9b3ba-4765-46ee-908e-6a6284f33708 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:34.199055 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:34.204038 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 278/561] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Sep 24 20:33:34 2022] PUT /identity/v3/projects/6e446dc5c12d49bca59e6e8c8ad90341/users/bc96ad30b91b46af92ff5b27a6b83abd/roles/6e079191d798481b811c5c8dca0c0f7a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:33:34.205015 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9b3ba-4765-46ee-908e-6a6284f33708 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:34.286938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8c1a3-4805-4364-ac62-1f43bc67dcce None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:34.301790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:34.328257 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1be67-a820-4ddd-a9a3-c4a099d593f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:34.328943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1be67-a820-4ddd-a9a3-c4a099d593f3 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:34.329225 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1be67-a820-4ddd-a9a3-c4a099d593f3 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:34.329501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1be67-a820-4ddd-a9a3-c4a099d593f3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:34.337364 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9b3ba-4765-46ee-908e-6a6284f33708 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:34.338555 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1be67-a820-4ddd-a9a3-c4a099d593f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:34.340019 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1be67-a820-4ddd-a9a3-c4a099d593f3 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:34.353943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-ffd1be67-a820-4ddd-a9a3-c4a099d593f3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 20:33:34.353943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:34.353943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:34.353943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:34.353943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:34.353943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:34.353943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:34.353943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:34.353943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:34.353943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:34.353943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:34.353943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:34.353943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:33:34.353943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:33:34.353943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:33:34.353943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:34.354970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:34.355889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:34.355889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:34.355889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:33:34.355889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:33:34.355889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:33:34.355889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:33:34.355889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:33:34.355889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:33:34.355889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 20:33:34.355889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:34.355889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 284/562] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:34.357748 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1be67-a820-4ddd-a9a3-c4a099d593f3 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:34.381731 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef26129-f981-461a-8679-547113d46403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:34.382268 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef26129-f981-461a-8679-547113d46403 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:34.382543 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef26129-f981-461a-8679-547113d46403 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:34.382809 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef26129-f981-461a-8679-547113d46403 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:34.383519 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef26129-f981-461a-8679-547113d46403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:34.383822 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef26129-f981-461a-8679-547113d46403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:34.385247 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef26129-f981-461a-8679-547113d46403 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:34.404689 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 279/563] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:34.404689 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef26129-f981-461a-8679-547113d46403 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:34.472780 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:34.478179 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1be67-a820-4ddd-a9a3-c4a099d593f3 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:34.512699 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d2fb9-d1f1-4ed6-963c-ef8d37eef8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:34.513323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d2fb9-d1f1-4ed6-963c-ef8d37eef8d2 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:34.513600 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d2fb9-d1f1-4ed6-963c-ef8d37eef8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:34.513870 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d2fb9-d1f1-4ed6-963c-ef8d37eef8d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:34.519436 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef26129-f981-461a-8679-547113d46403 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:34.521356 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d2fb9-d1f1-4ed6-963c-ef8d37eef8d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:34.522893 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d2fb9-d1f1-4ed6-963c-ef8d37eef8d2 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:34.534585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-d67d2fb9-d1f1-4ed6-963c-ef8d37eef8d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 20:33:34.534585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:34.534585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:34.534585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:34.534585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:34.534585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:34.534585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:34.534585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:34.534585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:34.534585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:34.534585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:34.534585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:34.534585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:33:34.534585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:33:34.534585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:33:34.534585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:34.535700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:34.536859 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:34.536859 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:34.536859 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:33:34.536859 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:33:34.536859 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:33:34.536859 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:33:34.536859 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:33:34.536859 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:33:34.536859 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 20:33:34.536859 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:34.536859 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 285/564] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:33:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:34.541190 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d2fb9-d1f1-4ed6-963c-ef8d37eef8d2 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:34.559779 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361304ae-0225-4e69-8689-ced443561a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:34.560677 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361304ae-0225-4e69-8689-ced443561a3b None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:34.561142 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361304ae-0225-4e69-8689-ced443561a3b None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:34.561599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361304ae-0225-4e69-8689-ced443561a3b None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:34.562467 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361304ae-0225-4e69-8689-ced443561a3b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:34.562957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361304ae-0225-4e69-8689-ced443561a3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:34.564562 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361304ae-0225-4e69-8689-ced443561a3b None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:34.573502 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:34.583677 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 280/565] 10.222.0.61 () {56 vars in 1137 bytes} [Sat Sep 24 20:33:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:34.584536 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361304ae-0225-4e69-8689-ced443561a3b None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:34.651689 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d2fb9-d1f1-4ed6-963c-ef8d37eef8d2 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:34.689851 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dc183-ecbd-48c1-9431-87aae45a0343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:34.690597 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dc183-ecbd-48c1-9431-87aae45a0343 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:34.690882 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dc183-ecbd-48c1-9431-87aae45a0343 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:34.691155 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520dc183-ecbd-48c1-9431-87aae45a0343 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:34.698961 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361304ae-0225-4e69-8689-ced443561a3b None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:34.699807 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520dc183-ecbd-48c1-9431-87aae45a0343 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:34.701289 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520dc183-ecbd-48c1-9431-87aae45a0343 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:34.713030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-520dc183-ecbd-48c1-9431-87aae45a0343 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 20:33:34.713030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:34.713030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:34.713030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:34.713030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:34.713030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:34.713030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:34.713030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:34.713030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:34.713030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:34.713030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:34.713030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:34.713030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:33:34.713030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:33:34.713030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:33:34.713030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:34.714182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:34.715334 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:34.715334 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:34.715334 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:33:34.715334 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:33:34.715334 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:33:34.715334 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:33:34.715334 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:33:34.715334 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:33:34.715334 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 20:33:34.715334 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:34.718742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 286/566] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:34.719555 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dc183-ecbd-48c1-9431-87aae45a0343 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:34.723915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:34.745344 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8810f-35d7-4311-9058-c7c77bcb8835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:34.745947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8810f-35d7-4311-9058-c7c77bcb8835 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:34.746229 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8810f-35d7-4311-9058-c7c77bcb8835 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:34.746503 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8810f-35d7-4311-9058-c7c77bcb8835 None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:34.747231 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8810f-35d7-4311-9058-c7c77bcb8835 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:34.747588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8810f-35d7-4311-9058-c7c77bcb8835 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:34.749056 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8810f-35d7-4311-9058-c7c77bcb8835 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:34.767879 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 281/567] 10.222.0.61 () {56 vars in 1139 bytes} [Sat Sep 24 20:33:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:34.768791 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8810f-35d7-4311-9058-c7c77bcb8835 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:34.826067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:34.835188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520dc183-ecbd-48c1-9431-87aae45a0343 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:34.869663 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe34a4f-291c-437a-a4db-1da987821148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:34.870291 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe34a4f-291c-437a-a4db-1da987821148 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:34.870569 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe34a4f-291c-437a-a4db-1da987821148 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:34.870842 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe34a4f-291c-437a-a4db-1da987821148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:34.879003 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8810f-35d7-4311-9058-c7c77bcb8835 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:34.881469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe34a4f-291c-437a-a4db-1da987821148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:34.882914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe34a4f-291c-437a-a4db-1da987821148 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:34.897505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-ffe34a4f-291c-437a-a4db-1da987821148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:34.897505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:34.897505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:34.897505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:34.897505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:34.897505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:34.897505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:34.897505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:34.897505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:34.897505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:34.897505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:34.897505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:34.897505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:34.897505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:34.897505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:34.897505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:34.898787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:34.900436 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:34.900436 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:34.900436 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:34.903788 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 287/568] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:34.904595 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe34a4f-291c-437a-a4db-1da987821148 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:34.920158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976f844-da44-4308-b727-4f41dc23a3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:34.921217 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976f844-da44-4308-b727-4f41dc23a3fd None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:34.921772 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976f844-da44-4308-b727-4f41dc23a3fd None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:34.922054 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976f844-da44-4308-b727-4f41dc23a3fd None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:34.922794 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976f844-da44-4308-b727-4f41dc23a3fd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:34.923102 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976f844-da44-4308-b727-4f41dc23a3fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:34.924564 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976f844-da44-4308-b727-4f41dc23a3fd None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:34.947982 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 282/569] 10.222.0.61 () {56 vars in 1137 bytes} [Sat Sep 24 20:33:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:34.947982 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976f844-da44-4308-b727-4f41dc23a3fd None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:34.983079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:35.012585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe34a4f-291c-437a-a4db-1da987821148 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:35.048947 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353502c3-0759-43fd-bf00-808aa518d0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:35.049659 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353502c3-0759-43fd-bf00-808aa518d0be None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:35.050008 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353502c3-0759-43fd-bf00-808aa518d0be None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:35.050419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353502c3-0759-43fd-bf00-808aa518d0be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:35.057149 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976f844-da44-4308-b727-4f41dc23a3fd None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:35.062616 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353502c3-0759-43fd-bf00-808aa518d0be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:35.064234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353502c3-0759-43fd-bf00-808aa518d0be None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:35.066874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:35.079596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-353502c3-0759-43fd-bf00-808aa518d0be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:35.079596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:35.079596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:35.079596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:35.079596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:35.079596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:35.079596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:35.079596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:35.079596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:35.079596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:35.079596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:35.079596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:35.079596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:35.079596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:35.079596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:35.079596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:35.080778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:35.081790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:35.081790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:35.081790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:35.081790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 288/570] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:35.086468 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353502c3-0759-43fd-bf00-808aa518d0be None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:35.099303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164f1a3-24c2-46a4-bfe5-ae40826cf8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:35.099917 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164f1a3-24c2-46a4-bfe5-ae40826cf8fc None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:35.100199 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164f1a3-24c2-46a4-bfe5-ae40826cf8fc None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:35.100880 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164f1a3-24c2-46a4-bfe5-ae40826cf8fc None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:35.101534 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164f1a3-24c2-46a4-bfe5-ae40826cf8fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:35.101891 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164f1a3-24c2-46a4-bfe5-ae40826cf8fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:35.103619 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164f1a3-24c2-46a4-bfe5-ae40826cf8fc None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:35.115721 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 283/571] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:35.116564 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164f1a3-24c2-46a4-bfe5-ae40826cf8fc None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:35.201918 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353502c3-0759-43fd-bf00-808aa518d0be None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:35.223036 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:35.233758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164f1a3-24c2-46a4-bfe5-ae40826cf8fc None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:35.238817 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8da52-1cb6-46c6-bb22-60fc0fc2d8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:35.239533 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8da52-1cb6-46c6-bb22-60fc0fc2d8e5 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:35.239883 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8da52-1cb6-46c6-bb22-60fc0fc2d8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:35.240230 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8da52-1cb6-46c6-bb22-60fc0fc2d8e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:35.251652 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8da52-1cb6-46c6-bb22-60fc0fc2d8e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:35.252984 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8da52-1cb6-46c6-bb22-60fc0fc2d8e5 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:35.267828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-83f8da52-1cb6-46c6-bb22-60fc0fc2d8e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:35.267828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:35.267828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:35.267828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:35.267828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:35.267828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:35.267828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:35.267828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:35.267828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:35.267828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:35.267828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:35.267828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:35.267828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:35.267828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:35.267828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:35.267828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:35.268872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:35.269768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:35.269768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:35.269768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:35.269768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 289/572] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:35.270001 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8da52-1cb6-46c6-bb22-60fc0fc2d8e5 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:35.275488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf15bb-c446-4d65-b349-73dce4591a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:35.276127 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf15bb-c446-4d65-b349-73dce4591a8a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:35.276427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf15bb-c446-4d65-b349-73dce4591a8a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:35.276727 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf15bb-c446-4d65-b349-73dce4591a8a None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:35.277372 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf15bb-c446-4d65-b349-73dce4591a8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:35.277678 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf15bb-c446-4d65-b349-73dce4591a8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:35.279043 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf15bb-c446-4d65-b349-73dce4591a8a None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:35.297722 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 284/573] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:35.297722 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf15bb-c446-4d65-b349-73dce4591a8a None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:35.323311 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:35.387311 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8da52-1cb6-46c6-bb22-60fc0fc2d8e5 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:35.403559 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf15bb-c446-4d65-b349-73dce4591a8a None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:35.423294 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedd5e6-bfe7-4f3e-8080-95c340f1a147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:35.424463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedd5e6-bfe7-4f3e-8080-95c340f1a147 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:35.424463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedd5e6-bfe7-4f3e-8080-95c340f1a147 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:35.424660 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedd5e6-bfe7-4f3e-8080-95c340f1a147 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:35.431885 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedd5e6-bfe7-4f3e-8080-95c340f1a147 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:35.433347 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedd5e6-bfe7-4f3e-8080-95c340f1a147 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:35.440538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2f097-02c9-4a37-8983-ba08da8f787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:35.441144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2f097-02c9-4a37-8983-ba08da8f787d None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:35.441423 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2f097-02c9-4a37-8983-ba08da8f787d None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:35.441694 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2f097-02c9-4a37-8983-ba08da8f787d None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:35.442322 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2f097-02c9-4a37-8983-ba08da8f787d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:35.442623 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2f097-02c9-4a37-8983-ba08da8f787d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:35.443966 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2f097-02c9-4a37-8983-ba08da8f787d None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:35.445256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-4eedd5e6-bfe7-4f3e-8080-95c340f1a147 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:35.445256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:35.445256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:35.445256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:35.445256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:35.445256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:35.445256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:35.445256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:35.445256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:35.445256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:35.445256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:35.445256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:35.445256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:33:35.445256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:33:35.445256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:35.446877 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:35.447819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:33:35.447819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:33:35.447819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:33:35.447819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:33:35.447819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:33:35.447819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:33:35.447819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:35.447819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:35.447819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 290/574] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:35.447819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedd5e6-bfe7-4f3e-8080-95c340f1a147 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:35.462364 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 285/575] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:35.463044 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2f097-02c9-4a37-8983-ba08da8f787d None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:35.478717 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:35.561812 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedd5e6-bfe7-4f3e-8080-95c340f1a147 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:35.572432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:35.574465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2f097-02c9-4a37-8983-ba08da8f787d None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:35.598667 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426410b2-45b4-4708-8c5f-e98c40954bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:35.599491 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426410b2-45b4-4708-8c5f-e98c40954bbf None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:35.599946 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426410b2-45b4-4708-8c5f-e98c40954bbf None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:35.600224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426410b2-45b4-4708-8c5f-e98c40954bbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:35.607132 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426410b2-45b4-4708-8c5f-e98c40954bbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:35.608594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426410b2-45b4-4708-8c5f-e98c40954bbf None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:35.611428 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170eebb-4739-4be0-83e9-725a395a4f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:35.612007 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170eebb-4739-4be0-83e9-725a395a4f55 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:35.612291 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170eebb-4739-4be0-83e9-725a395a4f55 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:35.612591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170eebb-4739-4be0-83e9-725a395a4f55 None admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:35.613273 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170eebb-4739-4be0-83e9-725a395a4f55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:35.613580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170eebb-4739-4be0-83e9-725a395a4f55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:35.615046 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170eebb-4739-4be0-83e9-725a395a4f55 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:35.619935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-426410b2-45b4-4708-8c5f-e98c40954bbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:35.619935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:35.619935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:35.619935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:35.619935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:35.619935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:35.619935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:35.619935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:35.619935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:35.619935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:35.619935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:35.619935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:35.619935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:33:35.619935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:33:35.619935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:35.621017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:35.621943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:33:35.621943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:33:35.621943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:33:35.621943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:33:35.621943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:33:35.621943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:33:35.621943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:35.621943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:35.624639 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 291/576] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:35.626205 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426410b2-45b4-4708-8c5f-e98c40954bbf None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:35.628174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 286/577] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:35.629021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170eebb-4739-4be0-83e9-725a395a4f55 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:35.700860 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:35.732383 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170eebb-4739-4be0-83e9-725a395a4f55 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:35.737634 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426410b2-45b4-4708-8c5f-e98c40954bbf None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:35.775591 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadcf04-c71f-4321-a7c6-fc4f822fbc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:35.776095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79b767-b266-4938-9bc9-f2d45a876d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:35.776484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadcf04-c71f-4321-a7c6-fc4f822fbc85 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:35.776728 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79b767-b266-4938-9bc9-f2d45a876d2e None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:35.776829 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadcf04-c71f-4321-a7c6-fc4f822fbc85 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:35.777014 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79b767-b266-4938-9bc9-f2d45a876d2e None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:35.777122 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadcf04-c71f-4321-a7c6-fc4f822fbc85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:35.777282 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79b767-b266-4938-9bc9-f2d45a876d2e None admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:35.778161 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79b767-b266-4938-9bc9-f2d45a876d2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:35.778470 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79b767-b266-4938-9bc9-f2d45a876d2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:35.779920 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79b767-b266-4938-9bc9-f2d45a876d2e None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:35.783833 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadcf04-c71f-4321-a7c6-fc4f822fbc85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:35.785292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cadcf04-c71f-4321-a7c6-fc4f822fbc85 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:35.797677 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 287/578] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:35.797677 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79b767-b266-4938-9bc9-f2d45a876d2e None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:35.803736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-9cadcf04-c71f-4321-a7c6-fc4f822fbc85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:35.803736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:35.803736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:35.803736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:35.803736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:35.803736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:35.803736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:35.803736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:35.803736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:35.803736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:35.803736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:35.803736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:35.803736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:33:35.803736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:33:35.803736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:35.804989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:35.806054 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:33:35.806054 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:33:35.806054 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:33:35.806054 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:33:35.806054 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:33:35.806054 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:33:35.806054 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:35.806054 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:35.808619 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 292/579] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:35.810031 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadcf04-c71f-4321-a7c6-fc4f822fbc85 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:35.844504 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:35.906918 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79b767-b266-4938-9bc9-f2d45a876d2e None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:35.918601 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cadcf04-c71f-4321-a7c6-fc4f822fbc85 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:35.941044 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:35.948133 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b87e5-1411-4206-aa10-138d403cfa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:35.948907 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b87e5-1411-4206-aa10-138d403cfa24 None admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:35.949262 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b87e5-1411-4206-aa10-138d403cfa24 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:35.949605 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b87e5-1411-4206-aa10-138d403cfa24 None admin] PATH_INFO: `/v3/projects/6e446dc5c12d49bca59e6e8c8ad90341/users/b505bdb933aa4bffa870851e4cb87c59/roles/6e079191d798481b811c5c8dca0c0f7a` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:35.956268 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abd936-f3be-4bed-b949-a1339b8f3d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:35.956967 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abd936-f3be-4bed-b949-a1339b8f3d71 None admin] REQUEST_METHOD: `PUT` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:35.957316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abd936-f3be-4bed-b949-a1339b8f3d71 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:35.957656 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abd936-f3be-4bed-b949-a1339b8f3d71 None admin] PATH_INFO: `/v3/projects/6e446dc5c12d49bca59e6e8c8ad90341/users/0e97928ca3294ebdbc53468d84c64b26/roles/6e079191d798481b811c5c8dca0c0f7a` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:35.966299 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b87e5-1411-4206-aa10-138d403cfa24 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e446dc5c12d49bca59e6e8c8ad90341, user_id=b505bdb933aa4bffa870851e4cb87c59, role_id=6e079191d798481b811c5c8dca0c0f7a)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:35.968036 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b87e5-1411-4206-aa10-138d403cfa24 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:35.973559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abd936-f3be-4bed-b949-a1339b8f3d71 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e446dc5c12d49bca59e6e8c8ad90341, user_id=0e97928ca3294ebdbc53468d84c64b26, role_id=6e079191d798481b811c5c8dca0c0f7a)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:35.975123 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abd936-f3be-4bed-b949-a1339b8f3d71 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:35.983358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 288/580] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Sep 24 20:33:35 2022] PUT /identity/v3/projects/6e446dc5c12d49bca59e6e8c8ad90341/users/b505bdb933aa4bffa870851e4cb87c59/roles/6e079191d798481b811c5c8dca0c0f7a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:33:35.984505 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b87e5-1411-4206-aa10-138d403cfa24 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:36.004051 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 293/581] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Sep 24 20:33:35 2022] PUT /identity/v3/projects/6e446dc5c12d49bca59e6e8c8ad90341/users/0e97928ca3294ebdbc53468d84c64b26/roles/6e079191d798481b811c5c8dca0c0f7a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:33:36.118620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b87e5-1411-4206-aa10-138d403cfa24 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:36.169136 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73e73a-ce70-4ed2-8113-23a1567fec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:36.169865 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73e73a-ce70-4ed2-8113-23a1567fec6a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:36.170248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73e73a-ce70-4ed2-8113-23a1567fec6a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:36.170618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73e73a-ce70-4ed2-8113-23a1567fec6a None admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:36.171423 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73e73a-ce70-4ed2-8113-23a1567fec6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:36.171831 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73e73a-ce70-4ed2-8113-23a1567fec6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:36.177549 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73e73a-ce70-4ed2-8113-23a1567fec6a None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:36.189600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 289/582] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:33:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:36.195912 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abd936-f3be-4bed-b949-a1339b8f3d71 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:36.294645 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:36.321565 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abd936-f3be-4bed-b949-a1339b8f3d71 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:36.357674 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70bf05-3a86-4d01-a3aa-3a3ad59b3933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:36.358355 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70bf05-3a86-4d01-a3aa-3a3ad59b3933 None admin] REQUEST_METHOD: `PUT` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:36.358635 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70bf05-3a86-4d01-a3aa-3a3ad59b3933 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:36.358907 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70bf05-3a86-4d01-a3aa-3a3ad59b3933 None admin] PATH_INFO: `/v3/projects/6e446dc5c12d49bca59e6e8c8ad90341/users/9e6e1fa10cb9487d8b346800e360c7a2/roles/6e079191d798481b811c5c8dca0c0f7a` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:36.375437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70bf05-3a86-4d01-a3aa-3a3ad59b3933 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e446dc5c12d49bca59e6e8c8ad90341, user_id=9e6e1fa10cb9487d8b346800e360c7a2, role_id=6e079191d798481b811c5c8dca0c0f7a)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:36.376976 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70bf05-3a86-4d01-a3aa-3a3ad59b3933 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:36.392223 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 294/583] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Sep 24 20:33:36 2022] PUT /identity/v3/projects/6e446dc5c12d49bca59e6e8c8ad90341/users/9e6e1fa10cb9487d8b346800e360c7a2/roles/6e079191d798481b811c5c8dca0c0f7a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:33:36.640821 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b229ec2-9983-4c5a-b8a9-65a3c3f57961 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:36.641317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b229ec2-9983-4c5a-b8a9-65a3c3f57961 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:36.641317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b229ec2-9983-4c5a-b8a9-65a3c3f57961 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:36.642758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 290/584] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:36.648375 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a54cb4-75ac-41c4-8610-279435a8e264 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:36.649723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a54cb4-75ac-41c4-8610-279435a8e264 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:36.650193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a54cb4-75ac-41c4-8610-279435a8e264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:36.669385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-e9a54cb4-75ac-41c4-8610-279435a8e264 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:36.670893 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-e9a54cb4-75ac-41c4-8610-279435a8e264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:36.743034 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 295/585] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:37.069250 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b229ec2-9983-4c5a-b8a9-65a3c3f57961 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:37.116843 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:37.179169 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b229ec2-9983-4c5a-b8a9-65a3c3f57961 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:37.219687 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba37446-a304-4bff-a3e3-8bfd3c7e112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:37.220324 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba37446-a304-4bff-a3e3-8bfd3c7e112a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:37.220687 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba37446-a304-4bff-a3e3-8bfd3c7e112a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:37.220965 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba37446-a304-4bff-a3e3-8bfd3c7e112a None admin] PATH_INFO: `/v3/roles/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:37.232060 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba37446-a304-4bff-a3e3-8bfd3c7e112a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:37.236915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-9ba37446-a304-4bff-a3e3-8bfd3c7e112a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:37.236915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:37.236915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:37.236915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:37.236915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:37.236915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:37.236915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:37.236915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:37.236915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:37.236915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:37.236915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:37.236915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:37.236915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:37.236915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:37.236915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:37.236915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:37.237812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:37.237812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:37.237812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:37.237812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:37.237812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:37.237812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:37.237812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:37.237812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:37.237812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:37.237812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:37.237812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:37.237812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:37.237812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:37.237812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:37.237812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:37.237812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:37.238651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:37.238651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:37.238651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:37.238651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:37.238651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:37.238651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:37.238651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:37.238651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:37.238651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:37.238651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:37.238651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:37.238651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:37.238651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 291/586] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:33:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:37.245730 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a54cb4-75ac-41c4-8610-279435a8e264 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:37.308156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:37.355226 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a54cb4-75ac-41c4-8610-279435a8e264 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:37.407287 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4af41-5670-4fbe-ae71-46238788b1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:37.408239 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4af41-5670-4fbe-ae71-46238788b1c9 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:37.408829 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4af41-5670-4fbe-ae71-46238788b1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:37.409296 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4af41-5670-4fbe-ae71-46238788b1c9 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:37.410152 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4af41-5670-4fbe-ae71-46238788b1c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:37.410651 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4af41-5670-4fbe-ae71-46238788b1c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:37.412197 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4af41-5670-4fbe-ae71-46238788b1c9 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:37.431411 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 296/587] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Sep 24 20:33:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:37.437711 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba37446-a304-4bff-a3e3-8bfd3c7e112a None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:37.558863 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba37446-a304-4bff-a3e3-8bfd3c7e112a None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:37.560322 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:37.595887 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a35b67-edbb-42aa-af57-4d08fe65d1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:37.596549 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a35b67-edbb-42aa-af57-4d08fe65d1a7 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:37.596829 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a35b67-edbb-42aa-af57-4d08fe65d1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:37.597102 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a35b67-edbb-42aa-af57-4d08fe65d1a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:37.608570 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a35b67-edbb-42aa-af57-4d08fe65d1a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:37.609961 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a35b67-edbb-42aa-af57-4d08fe65d1a7 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:37.624422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-79a35b67-edbb-42aa-af57-4d08fe65d1a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:37.624422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:37.624422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:37.624422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:37.624422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:37.624422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:37.624422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:37.624422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:37.624422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:37.624422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:37.624422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:37.624422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:37.624422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:37.624422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:37.624422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:37.624422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:37.625374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:37.626268 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:37.626268 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:37.626268 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:37.626268 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 292/588] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:37.631319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4af41-5670-4fbe-ae71-46238788b1c9 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:37.736847 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4af41-5670-4fbe-ae71-46238788b1c9 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:37.757184 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:37.774613 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56814d6-6ecb-4b2c-a661-9706ace3dc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:37.775222 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56814d6-6ecb-4b2c-a661-9706ace3dc98 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:37.775504 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56814d6-6ecb-4b2c-a661-9706ace3dc98 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:37.775776 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56814d6-6ecb-4b2c-a661-9706ace3dc98 None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:37.776442 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56814d6-6ecb-4b2c-a661-9706ace3dc98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:37.776804 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56814d6-6ecb-4b2c-a661-9706ace3dc98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:37.778208 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56814d6-6ecb-4b2c-a661-9706ace3dc98 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:37.793027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 297/589] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:37.798403 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a35b67-edbb-42aa-af57-4d08fe65d1a7 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:37.905014 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a35b67-edbb-42aa-af57-4d08fe65d1a7 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:37.939171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c614a3-3088-4359-bc67-2277ad417532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:37.939798 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c614a3-3088-4359-bc67-2277ad417532 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:37.940076 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c614a3-3088-4359-bc67-2277ad417532 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:37.940366 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c614a3-3088-4359-bc67-2277ad417532 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:37.948886 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c614a3-3088-4359-bc67-2277ad417532 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:37.950307 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c614a3-3088-4359-bc67-2277ad417532 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:37.961710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-52c614a3-3088-4359-bc67-2277ad417532 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 20:33:37.961710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:37.961710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:37.961710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:37.961710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:37.961710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:37.961710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:37.961710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:37.961710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:37.961710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:37.961710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:37.961710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:37.961710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:33:37.961710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:33:37.961710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:33:37.961710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:37.962640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:37.963566 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:37.963566 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:37.963566 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:33:37.963566 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:33:37.963566 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:33:37.963566 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:33:37.963566 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:33:37.963566 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:33:37.963566 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 20:33:37.963566 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:37.963566 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 293/590] 10.222.0.61 () {56 vars in 1093 bytes} [Sat Sep 24 20:33:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:37.968574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56814d6-6ecb-4b2c-a661-9706ace3dc98 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:38.078109 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56814d6-6ecb-4b2c-a661-9706ace3dc98 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:38.118079 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac561501-2381-4db4-bfdd-2108a31ac471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:38.119052 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac561501-2381-4db4-bfdd-2108a31ac471 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:38.119538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac561501-2381-4db4-bfdd-2108a31ac471 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:38.120033 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac561501-2381-4db4-bfdd-2108a31ac471 None admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:38.120988 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac561501-2381-4db4-bfdd-2108a31ac471 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:38.121498 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac561501-2381-4db4-bfdd-2108a31ac471 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:38.123118 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac561501-2381-4db4-bfdd-2108a31ac471 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:38.141919 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 298/591] 10.222.0.61 () {56 vars in 1133 bytes} [Sat Sep 24 20:33:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:38.147670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c614a3-3088-4359-bc67-2277ad417532 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:38.192886 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:38.272966 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c614a3-3088-4359-bc67-2277ad417532 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:38.308839 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d48e00-4418-4ef4-980c-b3bb8ae12b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:38.309449 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d48e00-4418-4ef4-980c-b3bb8ae12b32 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:38.309727 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d48e00-4418-4ef4-980c-b3bb8ae12b32 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:38.309998 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d48e00-4418-4ef4-980c-b3bb8ae12b32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:38.379024 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d48e00-4418-4ef4-980c-b3bb8ae12b32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:38.380434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d48e00-4418-4ef4-980c-b3bb8ae12b32 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:38.404714 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:38.488180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 294/592] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:38.493887 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac561501-2381-4db4-bfdd-2108a31ac471 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:38.536685 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:38.601218 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac561501-2381-4db4-bfdd-2108a31ac471 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:38.636536 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f188be-53fb-40ba-8908-0e4a442fb188 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:38.637145 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f188be-53fb-40ba-8908-0e4a442fb188 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:38.637704 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f188be-53fb-40ba-8908-0e4a442fb188 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:38.641502 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 295/593] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:33:38.643656 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feedc72-2834-4399-a3bd-7abc03083e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:38.644512 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485db03-55d0-4116-9fa9-47815831a6b7 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:38.644776 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feedc72-2834-4399-a3bd-7abc03083e79 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:38.644900 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485db03-55d0-4116-9fa9-47815831a6b7 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:38.645199 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485db03-55d0-4116-9fa9-47815831a6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:38.645529 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feedc72-2834-4399-a3bd-7abc03083e79 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:38.645977 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feedc72-2834-4399-a3bd-7abc03083e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:38.657580 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feedc72-2834-4399-a3bd-7abc03083e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:38.659035 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feedc72-2834-4399-a3bd-7abc03083e79 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:38.666797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-f485db03-55d0-4116-9fa9-47815831a6b7 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:38.668445 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-f485db03-55d0-4116-9fa9-47815831a6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:38.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-7feedc72-2834-4399-a3bd-7abc03083e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:38.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:38.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:38.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:38.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:38.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:38.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:38.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:38.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:38.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:38.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:38.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:38.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:38.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:38.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:38.674934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:38.675874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:38.677102 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:38.677102 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:38.677102 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:38.677102 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 299/594] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:38.677524 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a0023-8641-4647-937b-c79789ae0e47 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:38.677811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a0023-8641-4647-937b-c79789ae0e47 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:38.678098 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a0023-8641-4647-937b-c79789ae0e47 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:38.679546 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 300/595] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:38.685079 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a0023-8641-4647-937b-c79789ae0e47 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:38.747483 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 296/596] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:33:38.748564 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0f5a6-2cc7-4aa9-8018-937c7995bfb1 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:38.748802 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0f5a6-2cc7-4aa9-8018-937c7995bfb1 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:38.749081 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0f5a6-2cc7-4aa9-8018-937c7995bfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:38.767063 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-bca0f5a6-2cc7-4aa9-8018-937c7995bfb1 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:38.768273 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-bca0f5a6-2cc7-4aa9-8018-937c7995bfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:38.795596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:38.813886 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:38.814716 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a0023-8641-4647-937b-c79789ae0e47 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:38.852753 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 297/597] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:38.860254 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4e9d5-6670-4e3c-be4a-e15717a9ac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:38.861041 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4e9d5-6670-4e3c-be4a-e15717a9ac6d None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:38.861470 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4e9d5-6670-4e3c-be4a-e15717a9ac6d None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:38.861882 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4e9d5-6670-4e3c-be4a-e15717a9ac6d None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:38.862670 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4e9d5-6670-4e3c-be4a-e15717a9ac6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:38.863124 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4e9d5-6670-4e3c-be4a-e15717a9ac6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:38.864637 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4e9d5-6670-4e3c-be4a-e15717a9ac6d None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:38.877613 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 301/598] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:38.885244 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0f5a6-2cc7-4aa9-8018-937c7995bfb1 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:38.888732 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629b513-d1da-48ab-a291-b65178be5e95 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:38.889024 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629b513-d1da-48ab-a291-b65178be5e95 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:38.889301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629b513-d1da-48ab-a291-b65178be5e95 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:38.894380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 302/599] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:33:38.895768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d944dbf-423a-414d-b000-0f2aa08d3fcf None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:38.896066 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d944dbf-423a-414d-b000-0f2aa08d3fcf None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:38.896366 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d944dbf-423a-414d-b000-0f2aa08d3fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:38.914709 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-5d944dbf-423a-414d-b000-0f2aa08d3fcf None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:38.915908 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-5d944dbf-423a-414d-b000-0f2aa08d3fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:38.993104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0f5a6-2cc7-4aa9-8018-937c7995bfb1 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:38.996458 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 303/600] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:33:39.035102 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54b629-6497-4bf4-86e9-8112c9b458a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:39.035972 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54b629-6497-4bf4-86e9-8112c9b458a2 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:39.036417 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54b629-6497-4bf4-86e9-8112c9b458a2 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:39.036856 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54b629-6497-4bf4-86e9-8112c9b458a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:39.044009 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d54b629-6497-4bf4-86e9-8112c9b458a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:39.045635 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d54b629-6497-4bf4-86e9-8112c9b458a2 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:39.057781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-1d54b629-6497-4bf4-86e9-8112c9b458a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:39.057781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:39.057781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:39.057781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:39.057781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:39.057781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:39.057781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:39.057781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:39.057781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:39.057781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:39.057781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:39.057781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:39.057781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:33:39.057781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:33:39.057781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:39.058811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:39.059925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:33:39.059925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:33:39.059925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:33:39.059925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:33:39.059925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:33:39.059925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:33:39.059925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:39.059925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:39.061929 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 298/601] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:33:39.069021 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d944dbf-423a-414d-b000-0f2aa08d3fcf None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:39.116086 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54b629-6497-4bf4-86e9-8112c9b458a2 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:39.161475 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:39.167955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:39.192082 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d944dbf-423a-414d-b000-0f2aa08d3fcf None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:39.227653 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2e2f3-15cc-49f7-958a-b6ba0f8f85a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:39.228247 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2e2f3-15cc-49f7-958a-b6ba0f8f85a2 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:39.228565 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2e2f3-15cc-49f7-958a-b6ba0f8f85a2 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:39.228837 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2e2f3-15cc-49f7-958a-b6ba0f8f85a2 None admin] PATH_INFO: `/v3/projects` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:39.229513 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2e2f3-15cc-49f7-958a-b6ba0f8f85a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:39.229849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2e2f3-15cc-49f7-958a-b6ba0f8f85a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:39.231208 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2e2f3-15cc-49f7-958a-b6ba0f8f85a2 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:39.243036 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 304/602] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:33:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:39.248164 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2e2f3-15cc-49f7-958a-b6ba0f8f85a2 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:39.254278 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54b629-6497-4bf4-86e9-8112c9b458a2 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:39.293096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8fb3e-b69e-456b-bed3-49a63dbb3366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:39.293646 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8fb3e-b69e-456b-bed3-49a63dbb3366 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:39.293916 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8fb3e-b69e-456b-bed3-49a63dbb3366 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:39.294186 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8fb3e-b69e-456b-bed3-49a63dbb3366 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:39.304354 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8fb3e-b69e-456b-bed3-49a63dbb3366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:39.309613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-6ce8fb3e-b69e-456b-bed3-49a63dbb3366 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:39.309613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:39.309613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:39.309613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:39.309613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:39.309613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:39.309613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:39.309613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:39.309613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:39.309613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:39.309613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:39.309613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:39.309613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:39.309613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:39.309613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:39.309613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:39.310532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:39.310532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:39.310532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:39.310532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:39.310532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:39.310532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:39.310532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:39.310532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:39.310532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:39.310532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:39.310532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:39.310532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:39.310532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:39.310532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:39.310532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:39.310532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:39.311351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:39.311351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:39.311351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:39.311351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:39.311351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:39.311351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:39.311351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:39.311351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:39.311351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:39.311351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:39.311351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:39.311351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:39.311351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 299/603] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:33:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:33:39.312113 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8fb3e-b69e-456b-bed3-49a63dbb3366 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:39.351559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2e2f3-15cc-49f7-958a-b6ba0f8f85a2 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:39.384633 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b7811-12ba-4af7-a9d5-c71daff7699f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:39.385255 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b7811-12ba-4af7-a9d5-c71daff7699f None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:39.385538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b7811-12ba-4af7-a9d5-c71daff7699f None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:39.385814 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b7811-12ba-4af7-a9d5-c71daff7699f None admin] PATH_INFO: `/v3/roles/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:39.393222 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:39.396993 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b7811-12ba-4af7-a9d5-c71daff7699f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:39.402131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-915b7811-12ba-4af7-a9d5-c71daff7699f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:39.402131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:39.402131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:39.402131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:39.402131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:39.402131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:39.402131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:39.402131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:39.402131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:39.402131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:39.402131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:39.402131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:39.402131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:39.402131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:39.402131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:39.402131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:39.403064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:39.403064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:39.403064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:39.403064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:39.403064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:39.403064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:39.403064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:39.403064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:39.403064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:39.403064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:39.403064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:39.403064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:39.403064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:39.403064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:39.403064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:39.403064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:39.404067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:39.404067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:39.404067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:39.404067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:39.404067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:39.404067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:39.404067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:39.404067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:39.404067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:39.404067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:39.404067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:39.404067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:39.404067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 305/604] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:33:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:39.404968 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b7811-12ba-4af7-a9d5-c71daff7699f None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:39.406182 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:39.412859 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8fb3e-b69e-456b-bed3-49a63dbb3366 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:39.448753 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e3b3d-7bb5-4385-b1f0-ffac9f0ae0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:39.449347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e3b3d-7bb5-4385-b1f0-ffac9f0ae0ee None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:39.449624 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e3b3d-7bb5-4385-b1f0-ffac9f0ae0ee None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:39.449896 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e3b3d-7bb5-4385-b1f0-ffac9f0ae0ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:39.450612 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e3b3d-7bb5-4385-b1f0-ffac9f0ae0ee None admin] RBAC: Adding query filter params (role.id=6e079191d798481b811c5c8dca0c0f7a, scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341, user.id=bc96ad30b91b46af92ff5b27a6b83abd) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:39.450920 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e3b3d-7bb5-4385-b1f0-ffac9f0ae0ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:39.452327 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e3b3d-7bb5-4385-b1f0-ffac9f0ae0ee None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:39.457934 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 300/605] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:33:39 2022] GET /identity/v3/role_assignments?user.id=bc96ad30b91b46af92ff5b27a6b83abd&scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341&role.id=6e079191d798481b811c5c8dca0c0f7a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:39.458706 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e3b3d-7bb5-4385-b1f0-ffac9f0ae0ee None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:39.534691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b7811-12ba-4af7-a9d5-c71daff7699f None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:39.572128 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d90a5e-7cfa-4f82-99c1-0c907080c240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:39.573047 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d90a5e-7cfa-4f82-99c1-0c907080c240 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:39.573331 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d90a5e-7cfa-4f82-99c1-0c907080c240 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:39.573606 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d90a5e-7cfa-4f82-99c1-0c907080c240 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:39.574285 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d90a5e-7cfa-4f82-99c1-0c907080c240 None admin] RBAC: Adding query filter params (name=service) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:39.574591 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d90a5e-7cfa-4f82-99c1-0c907080c240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:39.575458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e3b3d-7bb5-4385-b1f0-ffac9f0ae0ee None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:39.575989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d90a5e-7cfa-4f82-99c1-0c907080c240 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:39.588400 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 306/606] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Sep 24 20:33:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:39.588400 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d90a5e-7cfa-4f82-99c1-0c907080c240 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:39.619863 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0642b62-b305-4d11-9c13-c945e992cf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:39.620737 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0642b62-b305-4d11-9c13-c945e992cf81 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:39.621104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0642b62-b305-4d11-9c13-c945e992cf81 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:39.621506 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0642b62-b305-4d11-9c13-c945e992cf81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:39.634191 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0642b62-b305-4d11-9c13-c945e992cf81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:39.640011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-a0642b62-b305-4d11-9c13-c945e992cf81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:39.640011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:39.640011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:39.640011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:39.640011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:39.640011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:39.640011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:39.640011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:39.640011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:39.640011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:39.640011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:39.640011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:39.640011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:39.640011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:39.640011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:39.640011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:39.641227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:39.641227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:39.641227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:39.641227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:39.641227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:39.641227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:39.641227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:39.641227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:39.641227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:39.641227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:39.641227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:39.641227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:39.641227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:39.641227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:39.641227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:39.641227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:39.642257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:39.642257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:39.642257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:39.642257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:39.642257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:39.642257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:39.642257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:39.642257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:39.642257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:39.642257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:39.642257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:33:39.642257 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:39.643179 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 301/607] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:33:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:39.644009 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0642b62-b305-4d11-9c13-c945e992cf81 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:39.660817 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:39.669770 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:39.707832 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d90a5e-7cfa-4f82-99c1-0c907080c240 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:39.750739 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e88ba-2c6a-43b0-bc7f-fed40d172054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:39.751349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e88ba-2c6a-43b0-bc7f-fed40d172054 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:39.751628 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e88ba-2c6a-43b0-bc7f-fed40d172054 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:39.751903 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e88ba-2c6a-43b0-bc7f-fed40d172054 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:39.752601 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e88ba-2c6a-43b0-bc7f-fed40d172054 None admin] RBAC: Adding query filter params (name=service) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:39.752909 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e88ba-2c6a-43b0-bc7f-fed40d172054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:39.754289 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e88ba-2c6a-43b0-bc7f-fed40d172054 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:39.763538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 307/608] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Sep 24 20:33:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:39.764497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e88ba-2c6a-43b0-bc7f-fed40d172054 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:39.771281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0642b62-b305-4d11-9c13-c945e992cf81 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:39.808737 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8331f3-50cc-47e9-87e5-f70a0dd93b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:39.809517 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8331f3-50cc-47e9-87e5-f70a0dd93b36 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:39.809892 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8331f3-50cc-47e9-87e5-f70a0dd93b36 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:39.810244 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8331f3-50cc-47e9-87e5-f70a0dd93b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:39.822032 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8331f3-50cc-47e9-87e5-f70a0dd93b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:39.823545 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8331f3-50cc-47e9-87e5-f70a0dd93b36 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:39.838427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-ac8331f3-50cc-47e9-87e5-f70a0dd93b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:39.838427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:39.838427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:39.838427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:39.838427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:39.838427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:39.838427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:39.838427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:39.838427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:39.838427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:39.838427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:39.838427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:39.838427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:39.838427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:39.838427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:39.838427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:39.839588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:39.840554 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:39.840554 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:39.840554 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:39.840554 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 302/609] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:39.840781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8331f3-50cc-47e9-87e5-f70a0dd93b36 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:39.884572 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e88ba-2c6a-43b0-bc7f-fed40d172054 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:39.908395 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:39.914658 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:39.921110 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cdc84-17fe-4f9d-a3cc-fe261dbc4f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:39.921905 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cdc84-17fe-4f9d-a3cc-fe261dbc4f19 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:39.922257 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cdc84-17fe-4f9d-a3cc-fe261dbc4f19 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:39.922598 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cdc84-17fe-4f9d-a3cc-fe261dbc4f19 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:39.923332 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cdc84-17fe-4f9d-a3cc-fe261dbc4f19 None admin] RBAC: Adding query filter params (name=service) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:39.923704 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cdc84-17fe-4f9d-a3cc-fe261dbc4f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:39.925176 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6cdc84-17fe-4f9d-a3cc-fe261dbc4f19 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:39.933791 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 308/610] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Sep 24 20:33:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:39.934410 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cdc84-17fe-4f9d-a3cc-fe261dbc4f19 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:39.954589 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8331f3-50cc-47e9-87e5-f70a0dd93b36 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:39.992177 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3389b-f643-4fec-8d4b-c83f409e0e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:39.992877 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3389b-f643-4fec-8d4b-c83f409e0e68 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:39.993152 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3389b-f643-4fec-8d4b-c83f409e0e68 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:39.993421 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3389b-f643-4fec-8d4b-c83f409e0e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:40.003939 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3389b-f643-4fec-8d4b-c83f409e0e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:40.005905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3389b-f643-4fec-8d4b-c83f409e0e68 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:40.021146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-70b3389b-f643-4fec-8d4b-c83f409e0e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:40.021146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:40.021146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:40.021146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:40.021146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:40.021146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:40.021146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:40.021146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:40.021146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:40.021146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:40.021146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:40.021146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:40.021146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:40.021146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:40.021146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:40.021146 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:40.022303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:40.023629 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:40.023629 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:40.023629 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:40.027137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 303/611] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:40.027829 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3389b-f643-4fec-8d4b-c83f409e0e68 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:40.044745 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cdc84-17fe-4f9d-a3cc-fe261dbc4f19 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:40.087862 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81464a3-6f9a-4e70-b45c-2df1d656323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:40.088420 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81464a3-6f9a-4e70-b45c-2df1d656323c None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:40.088707 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81464a3-6f9a-4e70-b45c-2df1d656323c None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:40.088980 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81464a3-6f9a-4e70-b45c-2df1d656323c None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:40.089624 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81464a3-6f9a-4e70-b45c-2df1d656323c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:40.089930 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81464a3-6f9a-4e70-b45c-2df1d656323c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:40.091284 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81464a3-6f9a-4e70-b45c-2df1d656323c None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:40.106916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 309/612] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:40.108532 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81464a3-6f9a-4e70-b45c-2df1d656323c None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:40.149527 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3389b-f643-4fec-8d4b-c83f409e0e68 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:40.166071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:40.182996 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:40.195459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4ffee-8d1e-4b0d-ba84-f20ff078ceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:40.196900 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4ffee-8d1e-4b0d-ba84-f20ff078ceac None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:40.197188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4ffee-8d1e-4b0d-ba84-f20ff078ceac None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:40.197466 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4ffee-8d1e-4b0d-ba84-f20ff078ceac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:40.209504 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4ffee-8d1e-4b0d-ba84-f20ff078ceac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:40.211611 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4ffee-8d1e-4b0d-ba84-f20ff078ceac None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:40.226260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-6ff4ffee-8d1e-4b0d-ba84-f20ff078ceac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:40.226260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:40.226260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:40.226260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:40.226260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:40.226260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:40.226260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:40.226260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:40.226260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:40.226260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:40.226260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:40.226260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:40.226260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:40.226260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:40.226260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:40.226260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:40.227494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:40.228626 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:40.228626 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:40.228626 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:40.229365 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81464a3-6f9a-4e70-b45c-2df1d656323c None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:40.232523 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 304/613] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:40.233040 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4ffee-8d1e-4b0d-ba84-f20ff078ceac None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:40.265706 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0917013-3eec-4ae3-bcbd-a169576e557c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:40.266312 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0917013-3eec-4ae3-bcbd-a169576e557c None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:40.266589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0917013-3eec-4ae3-bcbd-a169576e557c None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:40.266897 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0917013-3eec-4ae3-bcbd-a169576e557c None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:40.267515 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0917013-3eec-4ae3-bcbd-a169576e557c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:40.267804 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0917013-3eec-4ae3-bcbd-a169576e557c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:40.269190 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0917013-3eec-4ae3-bcbd-a169576e557c None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:40.281874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 310/614] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:40.282682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0917013-3eec-4ae3-bcbd-a169576e557c None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:40.345036 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4ffee-8d1e-4b0d-ba84-f20ff078ceac None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:40.380415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e53dc-3ef2-4230-9c91-caddcaa06424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:40.381038 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e53dc-3ef2-4230-9c91-caddcaa06424 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:40.381324 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e53dc-3ef2-4230-9c91-caddcaa06424 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:40.381590 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e53dc-3ef2-4230-9c91-caddcaa06424 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:40.384612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0917013-3eec-4ae3-bcbd-a169576e557c None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:40.389303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e53dc-3ef2-4230-9c91-caddcaa06424 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:40.390963 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e53dc-3ef2-4230-9c91-caddcaa06424 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:40.391793 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:40.408901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-4b4e53dc-3ef2-4230-9c91-caddcaa06424 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 20:33:40.408901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:40.408901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:40.408901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:40.408901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:40.408901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:40.408901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:40.408901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:40.408901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:40.408901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:40.408901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:40.408901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:40.408901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:33:40.408901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:33:40.408901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:33:40.408901 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:40.410321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:40.411438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:40.411438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:40.411438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:33:40.411438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:33:40.411438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:33:40.411438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:33:40.411438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:33:40.411438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:33:40.411438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 20:33:40.411438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:40.419162 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 305/615] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:33:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:40.420407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e53dc-3ef2-4230-9c91-caddcaa06424 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:40.426582 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702e69c-d8fc-42d9-ac6e-c820ae040709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:40.427186 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702e69c-d8fc-42d9-ac6e-c820ae040709 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:40.427466 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702e69c-d8fc-42d9-ac6e-c820ae040709 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:40.427739 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702e69c-d8fc-42d9-ac6e-c820ae040709 None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:40.428418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702e69c-d8fc-42d9-ac6e-c820ae040709 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:40.428726 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702e69c-d8fc-42d9-ac6e-c820ae040709 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:40.430188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702e69c-d8fc-42d9-ac6e-c820ae040709 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:40.441683 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 311/616] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:40.442493 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702e69c-d8fc-42d9-ac6e-c820ae040709 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:40.464211 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:40.540785 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e53dc-3ef2-4230-9c91-caddcaa06424 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:40.546637 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702e69c-d8fc-42d9-ac6e-c820ae040709 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:40.576235 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc523c-a9aa-4515-adca-57453137f4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:40.577149 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc523c-a9aa-4515-adca-57453137f4b5 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:40.577429 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc523c-a9aa-4515-adca-57453137f4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:40.577703 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc523c-a9aa-4515-adca-57453137f4b5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:40.580208 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ec459-e521-4123-967f-08700b573d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:40.580835 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ec459-e521-4123-967f-08700b573d60 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:40.581111 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ec459-e521-4123-967f-08700b573d60 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:40.581380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ec459-e521-4123-967f-08700b573d60 None admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:40.582090 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ec459-e521-4123-967f-08700b573d60 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:40.582396 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ec459-e521-4123-967f-08700b573d60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:40.583802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ec459-e521-4123-967f-08700b573d60 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:40.585253 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc523c-a9aa-4515-adca-57453137f4b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:40.587188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc523c-a9aa-4515-adca-57453137f4b5 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:40.599702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-86dc523c-a9aa-4515-adca-57453137f4b5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 20:33:40.599702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:40.599702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:40.599702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:40.599702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:40.599702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:40.599702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:40.599702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:40.599702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:40.599702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:40.599702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:40.599702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:40.599702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:33:40.599702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:33:40.599702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:33:40.599702 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:40.600799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:40.607591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:40.607591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:40.607591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:33:40.607591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:33:40.607591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:33:40.607591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:33:40.607591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:33:40.607591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:33:40.607591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 20:33:40.607591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:40.607591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 306/617] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:40.607591 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc523c-a9aa-4515-adca-57453137f4b5 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:40.608265 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 312/618] 10.222.0.61 () {56 vars in 1139 bytes} [Sat Sep 24 20:33:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:40.608265 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ec459-e521-4123-967f-08700b573d60 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:40.634967 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:40.705735 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:40.713609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ec459-e521-4123-967f-08700b573d60 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:40.714037 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc523c-a9aa-4515-adca-57453137f4b5 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:40.753721 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b109fcc-7b1e-4b32-b642-7cb7a7cf3383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:40.754358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b109fcc-7b1e-4b32-b642-7cb7a7cf3383 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:40.754638 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b109fcc-7b1e-4b32-b642-7cb7a7cf3383 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:40.754909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b109fcc-7b1e-4b32-b642-7cb7a7cf3383 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:40.755268 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654a5bd-69f3-485f-8328-7ce2712fc975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:40.755926 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654a5bd-69f3-485f-8328-7ce2712fc975 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:40.756210 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654a5bd-69f3-485f-8328-7ce2712fc975 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:40.756513 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654a5bd-69f3-485f-8328-7ce2712fc975 None admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:40.757236 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654a5bd-69f3-485f-8328-7ce2712fc975 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:40.757542 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654a5bd-69f3-485f-8328-7ce2712fc975 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:40.759001 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654a5bd-69f3-485f-8328-7ce2712fc975 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:40.763231 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b109fcc-7b1e-4b32-b642-7cb7a7cf3383 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:40.764685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b109fcc-7b1e-4b32-b642-7cb7a7cf3383 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:40.776621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-4b109fcc-7b1e-4b32-b642-7cb7a7cf3383 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 20:33:40.776621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:40.776621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:40.776621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:40.776621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:40.776621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:40.776621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:40.776621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:40.776621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:40.776621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:40.776621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:40.776621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:40.776621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:33:40.776621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:33:40.776621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:33:40.776621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:40.777675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:40.778598 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:40.778598 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:40.778598 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:33:40.778598 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:33:40.778598 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:33:40.778598 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:33:40.778598 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:33:40.778598 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:33:40.778598 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 20:33:40.778598 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:40.779146 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 313/619] 10.222.0.61 () {56 vars in 1137 bytes} [Sat Sep 24 20:33:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:40.779146 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654a5bd-69f3-485f-8328-7ce2712fc975 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:40.782229 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 307/620] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:40.782931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b109fcc-7b1e-4b32-b642-7cb7a7cf3383 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:40.885786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:40.889235 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b109fcc-7b1e-4b32-b642-7cb7a7cf3383 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:40.907479 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654a5bd-69f3-485f-8328-7ce2712fc975 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:40.924247 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dab201-7ab4-471d-a099-23fb4fec391e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:40.924909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dab201-7ab4-471d-a099-23fb4fec391e None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:40.925147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dab201-7ab4-471d-a099-23fb4fec391e None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:40.925417 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dab201-7ab4-471d-a099-23fb4fec391e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:40.945926 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920b043-65aa-40df-a8fb-ef0f1a764ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:40.946524 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920b043-65aa-40df-a8fb-ef0f1a764ebd None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:40.946802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920b043-65aa-40df-a8fb-ef0f1a764ebd None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:40.947073 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920b043-65aa-40df-a8fb-ef0f1a764ebd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:40.951194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:40.998612 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dab201-7ab4-471d-a099-23fb4fec391e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:41.000437 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dab201-7ab4-471d-a099-23fb4fec391e None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:41.017962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920b043-65aa-40df-a8fb-ef0f1a764ebd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:41.019654 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920b043-65aa-40df-a8fb-ef0f1a764ebd None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:41.106653 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 308/621] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:41.107487 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dab201-7ab4-471d-a099-23fb4fec391e None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:41.114573 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:41.140573 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 314/622] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:41.141483 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920b043-65aa-40df-a8fb-ef0f1a764ebd None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:41.176091 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:41.235345 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dab201-7ab4-471d-a099-23fb4fec391e None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:41.249636 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920b043-65aa-40df-a8fb-ef0f1a764ebd None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:41.276946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ab67f-8f7b-497e-9908-d3ee4b7cbd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:41.277496 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ab67f-8f7b-497e-9908-d3ee4b7cbd73 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:41.277775 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ab67f-8f7b-497e-9908-d3ee4b7cbd73 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:41.278176 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ab67f-8f7b-497e-9908-d3ee4b7cbd73 None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:41.278754 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ab67f-8f7b-497e-9908-d3ee4b7cbd73 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:41.279066 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ab67f-8f7b-497e-9908-d3ee4b7cbd73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:41.280507 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ab67f-8f7b-497e-9908-d3ee4b7cbd73 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:41.286046 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c360a6-54f5-472b-b20c-ac2823749d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:41.286663 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c360a6-54f5-472b-b20c-ac2823749d53 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:41.286938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c360a6-54f5-472b-b20c-ac2823749d53 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:41.287325 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c360a6-54f5-472b-b20c-ac2823749d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:41.298523 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c360a6-54f5-472b-b20c-ac2823749d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:41.300045 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c360a6-54f5-472b-b20c-ac2823749d53 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:41.303184 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 309/623] 10.222.0.61 () {56 vars in 1137 bytes} [Sat Sep 24 20:33:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:41.303906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ab67f-8f7b-497e-9908-d3ee4b7cbd73 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:41.318419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-20c360a6-54f5-472b-b20c-ac2823749d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:41.318419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:41.318419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:41.318419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:41.318419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:41.318419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:41.318419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:41.318419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:41.318419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:41.318419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:41.318419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:41.318419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:41.318419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:41.318419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:41.318419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:41.318419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:41.319559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:41.320746 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:41.320746 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:41.320746 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:41.321406 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 315/624] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:41.322232 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c360a6-54f5-472b-b20c-ac2823749d53 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:41.360117 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:41.419664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ab67f-8f7b-497e-9908-d3ee4b7cbd73 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:41.430278 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c360a6-54f5-472b-b20c-ac2823749d53 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:41.434079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:41.456436 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523307b3-dcd2-464b-9659-ae619f194668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:41.457068 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523307b3-dcd2-464b-9659-ae619f194668 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:41.457351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523307b3-dcd2-464b-9659-ae619f194668 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:41.457628 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523307b3-dcd2-464b-9659-ae619f194668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:41.468363 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523307b3-dcd2-464b-9659-ae619f194668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:41.469297 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474c0bc-f011-4cf9-ac68-e4514809e1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:41.469817 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523307b3-dcd2-464b-9659-ae619f194668 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:41.470339 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474c0bc-f011-4cf9-ac68-e4514809e1c3 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:41.470826 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474c0bc-f011-4cf9-ac68-e4514809e1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:41.471245 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474c0bc-f011-4cf9-ac68-e4514809e1c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:41.484943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-523307b3-dcd2-464b-9659-ae619f194668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:41.484943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:41.484943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:41.484943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:41.484943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:41.484943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:41.484943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:41.484943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:41.484943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:41.484943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:41.484943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:41.484943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:41.484943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:41.484943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:41.484943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:41.484943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:41.486095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:41.487185 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:41.487185 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:41.487185 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:41.490672 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 310/625] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:41.491526 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523307b3-dcd2-464b-9659-ae619f194668 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:41.557230 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474c0bc-f011-4cf9-ac68-e4514809e1c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:41.558773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474c0bc-f011-4cf9-ac68-e4514809e1c3 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:41.595497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:41.606120 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523307b3-dcd2-464b-9659-ae619f194668 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:41.641584 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e248f-d083-4013-9fae-04dc5878f6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:41.642207 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e248f-d083-4013-9fae-04dc5878f6d6 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:41.642463 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e248f-d083-4013-9fae-04dc5878f6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:41.642735 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e248f-d083-4013-9fae-04dc5878f6d6 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:41.643368 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e248f-d083-4013-9fae-04dc5878f6d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:41.643671 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e248f-d083-4013-9fae-04dc5878f6d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:41.645215 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e248f-d083-4013-9fae-04dc5878f6d6 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:41.657711 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 311/626] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:41.662775 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e248f-d083-4013-9fae-04dc5878f6d6 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:41.677851 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 316/627] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:41.677851 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474c0bc-f011-4cf9-ac68-e4514809e1c3 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:41.691620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:41.777166 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e248f-d083-4013-9fae-04dc5878f6d6 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:41.790837 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474c0bc-f011-4cf9-ac68-e4514809e1c3 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:41.815499 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e54bd4-f077-41be-9fb6-d074fd85721c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:41.816098 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e54bd4-f077-41be-9fb6-d074fd85721c None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:41.816406 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e54bd4-f077-41be-9fb6-d074fd85721c None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:41.816740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e54bd4-f077-41be-9fb6-d074fd85721c None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:41.817370 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e54bd4-f077-41be-9fb6-d074fd85721c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:41.817689 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e54bd4-f077-41be-9fb6-d074fd85721c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:41.819213 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e54bd4-f077-41be-9fb6-d074fd85721c None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:41.828412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad5369-414e-46ef-9c65-fa51b6be8646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:41.829043 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad5369-414e-46ef-9c65-fa51b6be8646 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:41.829321 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad5369-414e-46ef-9c65-fa51b6be8646 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:41.829594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad5369-414e-46ef-9c65-fa51b6be8646 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:41.834897 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 312/628] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:41.834897 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e54bd4-f077-41be-9fb6-d074fd85721c None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:41.837910 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:41.842809 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad5369-414e-46ef-9c65-fa51b6be8646 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:41.845109 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad5369-414e-46ef-9c65-fa51b6be8646 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:41.857053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-18ad5369-414e-46ef-9c65-fa51b6be8646 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:41.857053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:41.857053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:41.857053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:41.857053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:41.857053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:41.857053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:41.857053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:41.857053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:41.857053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:41.857053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:41.857053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:41.857053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:33:41.857053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:33:41.857053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:41.857938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:41.858807 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:33:41.858807 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:33:41.858807 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:33:41.858807 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:33:41.858807 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:33:41.858807 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:33:41.858807 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:41.858807 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:41.858807 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 317/629] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:41.859787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad5369-414e-46ef-9c65-fa51b6be8646 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:41.926900 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:41.945104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e54bd4-f077-41be-9fb6-d074fd85721c None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:41.969351 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad5369-414e-46ef-9c65-fa51b6be8646 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:41.980088 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97b9ab-322f-4c8f-8c27-a807a8127eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:41.980741 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97b9ab-322f-4c8f-8c27-a807a8127eb5 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:41.981021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97b9ab-322f-4c8f-8c27-a807a8127eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:41.981293 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97b9ab-322f-4c8f-8c27-a807a8127eb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:41.991703 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97b9ab-322f-4c8f-8c27-a807a8127eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:41.993209 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97b9ab-322f-4c8f-8c27-a807a8127eb5 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:42.003110 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29cd2d-e2d0-45b1-af9e-317a81db299a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:42.003728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29cd2d-e2d0-45b1-af9e-317a81db299a None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:42.004010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29cd2d-e2d0-45b1-af9e-317a81db299a None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:42.004285 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29cd2d-e2d0-45b1-af9e-317a81db299a None admin] PATH_INFO: `/v3/projects/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:42.007128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-fe97b9ab-322f-4c8f-8c27-a807a8127eb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:42.007128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:42.007128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:42.007128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:42.007128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:42.007128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:42.007128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:42.007128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:42.007128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:42.007128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:42.007128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:42.007128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:42.007128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:42.007128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:42.007128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:42.007128 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:42.008058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:42.009074 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:42.009074 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:42.009074 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:42.009074 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 313/630] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:42.009074 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97b9ab-322f-4c8f-8c27-a807a8127eb5 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:42.010953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29cd2d-e2d0-45b1-af9e-317a81db299a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:42.012401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29cd2d-e2d0-45b1-af9e-317a81db299a None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:42.024273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-2e29cd2d-e2d0-45b1-af9e-317a81db299a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:42.024273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:42.024273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:42.024273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:42.024273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:42.024273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:42.024273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:42.024273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:42.024273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:42.024273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:42.024273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:42.024273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:42.024273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:33:42.024273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:33:42.024273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:42.025269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:42.026151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:33:42.026151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:33:42.026151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:33:42.026151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:33:42.026151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:33:42.026151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:33:42.026151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:42.026151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:42.026151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 318/631] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:42.026621 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726ce56-bcdd-4907-9551-f4290ec3ca55 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:42.026991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726ce56-bcdd-4907-9551-f4290ec3ca55 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:42.027208 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726ce56-bcdd-4907-9551-f4290ec3ca55 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:42.028520 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 319/632] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:42.029140 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726ce56-bcdd-4907-9551-f4290ec3ca55 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:42.084698 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:42.128303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97b9ab-322f-4c8f-8c27-a807a8127eb5 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:42.139057 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726ce56-bcdd-4907-9551-f4290ec3ca55 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:42.162443 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d2c7e-28ee-4b43-9017-a447dd853506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:42.163273 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d2c7e-28ee-4b43-9017-a447dd853506 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:42.163710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d2c7e-28ee-4b43-9017-a447dd853506 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:42.164020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d2c7e-28ee-4b43-9017-a447dd853506 None admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:42.164753 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d2c7e-28ee-4b43-9017-a447dd853506 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:42.165062 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d2c7e-28ee-4b43-9017-a447dd853506 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:42.166734 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d2c7e-28ee-4b43-9017-a447dd853506 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:42.169293 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:42.173235 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5de09-e9a9-42b4-9823-c39c7ae5f8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:42.173839 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5de09-e9a9-42b4-9823-c39c7ae5f8cb None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:42.174122 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5de09-e9a9-42b4-9823-c39c7ae5f8cb None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:42.174401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5de09-e9a9-42b4-9823-c39c7ae5f8cb None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:42.175036 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5de09-e9a9-42b4-9823-c39c7ae5f8cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:42.175339 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5de09-e9a9-42b4-9823-c39c7ae5f8cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:42.177081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5de09-e9a9-42b4-9823-c39c7ae5f8cb None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:42.180397 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 314/633] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:42.181205 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d2c7e-28ee-4b43-9017-a447dd853506 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:42.191985 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 320/634] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:42.191985 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b6d77-64ce-406a-946f-7ed285797574 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:42.191985 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b6d77-64ce-406a-946f-7ed285797574 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:42.191985 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b6d77-64ce-406a-946f-7ed285797574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:42.210914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-058b6d77-64ce-406a-946f-7ed285797574 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:42.212584 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-058b6d77-64ce-406a-946f-7ed285797574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:42.277751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 321/635] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:42.278576 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b6d77-64ce-406a-946f-7ed285797574 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:42.283597 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d2c7e-28ee-4b43-9017-a447dd853506 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:42.320106 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2324e1e-491d-4b1c-b77a-cd834a2e2190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:42.320768 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2324e1e-491d-4b1c-b77a-cd834a2e2190 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:42.321054 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2324e1e-491d-4b1c-b77a-cd834a2e2190 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:42.321318 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2324e1e-491d-4b1c-b77a-cd834a2e2190 None admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:42.322001 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2324e1e-491d-4b1c-b77a-cd834a2e2190 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:42.322303 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2324e1e-491d-4b1c-b77a-cd834a2e2190 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:42.323699 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2324e1e-491d-4b1c-b77a-cd834a2e2190 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:42.325995 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:42.336358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 315/636] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:42.337277 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2324e1e-491d-4b1c-b77a-cd834a2e2190 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:42.391801 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:42.393740 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b6d77-64ce-406a-946f-7ed285797574 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:42.429199 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e77d2-3e08-4145-88dd-8b3a2ec32852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:42.430693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e77d2-3e08-4145-88dd-8b3a2ec32852 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:42.431251 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e77d2-3e08-4145-88dd-8b3a2ec32852 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:42.431596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e77d2-3e08-4145-88dd-8b3a2ec32852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:42.432325 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e77d2-3e08-4145-88dd-8b3a2ec32852 None admin] RBAC: Adding query filter params (role.id=6e079191d798481b811c5c8dca0c0f7a, scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341, user.id=b505bdb933aa4bffa870851e4cb87c59) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:42.432662 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e77d2-3e08-4145-88dd-8b3a2ec32852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:42.434221 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e77d2-3e08-4145-88dd-8b3a2ec32852 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:42.440497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 322/637] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:33:42 2022] GET /identity/v3/role_assignments?user.id=b505bdb933aa4bffa870851e4cb87c59&scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341&role.id=6e079191d798481b811c5c8dca0c0f7a => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:42.441265 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e77d2-3e08-4145-88dd-8b3a2ec32852 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:42.451648 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2324e1e-491d-4b1c-b77a-cd834a2e2190 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:42.495824 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cda6d-9294-4017-baa6-6c3bfc97046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:42.496387 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cda6d-9294-4017-baa6-6c3bfc97046e None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:42.496671 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cda6d-9294-4017-baa6-6c3bfc97046e None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:42.496942 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cda6d-9294-4017-baa6-6c3bfc97046e None admin] PATH_INFO: `/v3/projects/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:42.506488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cda6d-9294-4017-baa6-6c3bfc97046e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:42.507652 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cda6d-9294-4017-baa6-6c3bfc97046e None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:42.520992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-115cda6d-9294-4017-baa6-6c3bfc97046e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:42.520992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:42.520992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:42.520992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:42.520992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:42.520992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:42.520992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:42.520992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:42.520992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:42.520992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:42.520992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:42.520992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:42.520992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:33:42.520992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:33:42.520992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:42.521950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:42.524066 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:33:42.524066 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:33:42.524066 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:33:42.524066 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:33:42.524066 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:33:42.524066 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:33:42.524066 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:42.524066 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:42.524066 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 316/638] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:42.528235 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cda6d-9294-4017-baa6-6c3bfc97046e None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:42.587109 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e77d2-3e08-4145-88dd-8b3a2ec32852 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:42.597347 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:42.625809 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f72e20-8ed4-426e-a2fd-9845c2894034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:42.626418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f72e20-8ed4-426e-a2fd-9845c2894034 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:42.626694 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f72e20-8ed4-426e-a2fd-9845c2894034 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:42.626959 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f72e20-8ed4-426e-a2fd-9845c2894034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:42.627682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f72e20-8ed4-426e-a2fd-9845c2894034 None admin] RBAC: Adding query filter params (role.id=6e079191d798481b811c5c8dca0c0f7a, scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341, user.id=0e97928ca3294ebdbc53468d84c64b26) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:42.627986 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f72e20-8ed4-426e-a2fd-9845c2894034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:42.629488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f72e20-8ed4-426e-a2fd-9845c2894034 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:42.644389 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 323/639] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:33:42 2022] GET /identity/v3/role_assignments?user.id=0e97928ca3294ebdbc53468d84c64b26&scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341&role.id=6e079191d798481b811c5c8dca0c0f7a => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:42.644389 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f72e20-8ed4-426e-a2fd-9845c2894034 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:42.666507 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cda6d-9294-4017-baa6-6c3bfc97046e None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:42.689755 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:42.720175 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e96005-c887-4450-8c8b-8208a550db6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:42.720835 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e96005-c887-4450-8c8b-8208a550db6a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:42.721120 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e96005-c887-4450-8c8b-8208a550db6a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:42.721399 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e96005-c887-4450-8c8b-8208a550db6a None admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:42.722109 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e96005-c887-4450-8c8b-8208a550db6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:42.722419 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e96005-c887-4450-8c8b-8208a550db6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:42.723898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e96005-c887-4450-8c8b-8208a550db6a None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:42.739540 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 317/640] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:33:42.747692 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e96005-c887-4450-8c8b-8208a550db6a None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:42.771803 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f72e20-8ed4-426e-a2fd-9845c2894034 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:42.815389 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04083a-0f10-4ef3-9f33-3b62a81c66a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:42.816033 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04083a-0f10-4ef3-9f33-3b62a81c66a0 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:42.816310 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04083a-0f10-4ef3-9f33-3b62a81c66a0 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:42.816619 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04083a-0f10-4ef3-9f33-3b62a81c66a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:42.828375 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04083a-0f10-4ef3-9f33-3b62a81c66a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:42.833729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-cb04083a-0f10-4ef3-9f33-3b62a81c66a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:33:42.833729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:42.833729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:42.833729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:42.833729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:42.833729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:42.833729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:42.833729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:42.833729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:42.833729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:42.833729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:42.833729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:42.833729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:42.833729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:42.833729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:42.833729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:42.835002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:42.835002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:42.835002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:42.835002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:42.835002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:42.835002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:42.835002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:42.835002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:42.835002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:42.835002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:42.835002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:42.835002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:42.835002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:42.835002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:42.835002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:42.835002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:42.836742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:42.836742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:42.836742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:42.836742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:42.836742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:42.836742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:42.836742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:42.836742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:42.836742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:42.836742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:42.836742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:33:42.836742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:42.836742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 324/641] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:33:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:42.843536 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04083a-0f10-4ef3-9f33-3b62a81c66a0 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:42.882479 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:42.886723 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e96005-c887-4450-8c8b-8208a550db6a None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:42.938883 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb0765-5931-4aa4-b53a-7caca2677d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:42.939679 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb0765-5931-4aa4-b53a-7caca2677d3e None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:42.940055 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb0765-5931-4aa4-b53a-7caca2677d3e None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:42.940352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb0765-5931-4aa4-b53a-7caca2677d3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:42.941084 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb0765-5931-4aa4-b53a-7caca2677d3e None admin] RBAC: Adding query filter params (role.id=6e079191d798481b811c5c8dca0c0f7a, scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341, user.id=9e6e1fa10cb9487d8b346800e360c7a2) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:42.941397 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb0765-5931-4aa4-b53a-7caca2677d3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:42.942827 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb0765-5931-4aa4-b53a-7caca2677d3e None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:42.950025 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 318/642] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:33:42 2022] GET /identity/v3/role_assignments?user.id=9e6e1fa10cb9487d8b346800e360c7a2&scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341&role.id=6e079191d798481b811c5c8dca0c0f7a => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:33:42.979721 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04083a-0f10-4ef3-9f33-3b62a81c66a0 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:43.023898 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56947f2-16a7-4f37-a94c-09b74babba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:43.024668 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56947f2-16a7-4f37-a94c-09b74babba99 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:43.024955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56947f2-16a7-4f37-a94c-09b74babba99 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:43.025232 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56947f2-16a7-4f37-a94c-09b74babba99 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:43.025939 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56947f2-16a7-4f37-a94c-09b74babba99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:43.026249 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56947f2-16a7-4f37-a94c-09b74babba99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:43.027672 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56947f2-16a7-4f37-a94c-09b74babba99 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:43.038000 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 325/643] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:43.044363 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb0765-5931-4aa4-b53a-7caca2677d3e None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:43.091824 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:43.159734 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb0765-5931-4aa4-b53a-7caca2677d3e None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:43.195520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bca68b-8025-4a38-955b-231da8384f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:43.196157 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bca68b-8025-4a38-955b-231da8384f35 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:43.196468 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bca68b-8025-4a38-955b-231da8384f35 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:43.196745 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bca68b-8025-4a38-955b-231da8384f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:43.211553 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bca68b-8025-4a38-955b-231da8384f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:43.213145 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bca68b-8025-4a38-955b-231da8384f35 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:43.229622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-f7bca68b-8025-4a38-955b-231da8384f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:43.229622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:43.229622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:43.229622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:43.229622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:43.229622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:43.229622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:43.229622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:43.229622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:43.229622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:43.229622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:43.229622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:43.229622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:43.229622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:43.229622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:43.229622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:43.230580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:43.231458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:43.231458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:43.231458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:43.231458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 319/644] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:43.236520 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56947f2-16a7-4f37-a94c-09b74babba99 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:43.338576 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:43.346364 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56947f2-16a7-4f37-a94c-09b74babba99 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:43.382330 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc93a0b-861d-4078-879a-869ccb149716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:43.383004 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc93a0b-861d-4078-879a-869ccb149716 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:43.383287 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc93a0b-861d-4078-879a-869ccb149716 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:43.383562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc93a0b-861d-4078-879a-869ccb149716 None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:43.384213 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc93a0b-861d-4078-879a-869ccb149716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:43.384544 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc93a0b-861d-4078-879a-869ccb149716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:43.385909 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc93a0b-861d-4078-879a-869ccb149716 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:43.402781 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 326/645] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:43.408022 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bca68b-8025-4a38-955b-231da8384f35 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:43.507628 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:43.517652 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bca68b-8025-4a38-955b-231da8384f35 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:43.555295 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc40029-bd6d-416a-8501-1671baa7d381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:43.555938 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc40029-bd6d-416a-8501-1671baa7d381 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:43.556212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc40029-bd6d-416a-8501-1671baa7d381 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:43.556517 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc40029-bd6d-416a-8501-1671baa7d381 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:43.564447 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc40029-bd6d-416a-8501-1671baa7d381 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:43.565879 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc40029-bd6d-416a-8501-1671baa7d381 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:43.577455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-2bc40029-bd6d-416a-8501-1671baa7d381 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 20:33:43.577455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:43.577455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:43.577455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:43.577455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:43.577455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:43.577455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:43.577455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:43.577455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:43.577455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:43.577455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:43.577455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:43.577455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:33:43.577455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:33:43.577455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:33:43.577455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:43.578381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:43.579320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:43.579320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:43.579320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:33:43.579320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:33:43.579320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:33:43.579320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:33:43.579320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:33:43.579320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:33:43.579320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 20:33:43.579320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:43.579320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 320/646] 10.222.0.61 () {56 vars in 1093 bytes} [Sat Sep 24 20:33:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:43.584505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc93a0b-861d-4078-879a-869ccb149716 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:43.695354 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc93a0b-861d-4078-879a-869ccb149716 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:43.732469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d99de-47be-413a-9a94-1f0bc25c82a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:43.733076 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d99de-47be-413a-9a94-1f0bc25c82a9 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:43.733360 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d99de-47be-413a-9a94-1f0bc25c82a9 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:43.733637 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d99de-47be-413a-9a94-1f0bc25c82a9 None admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:43.734361 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d99de-47be-413a-9a94-1f0bc25c82a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:43.734668 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d99de-47be-413a-9a94-1f0bc25c82a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:43.736151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d99de-47be-413a-9a94-1f0bc25c82a9 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:43.754582 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 327/647] 10.222.0.61 () {56 vars in 1133 bytes} [Sat Sep 24 20:33:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:43.759815 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc40029-bd6d-416a-8501-1671baa7d381 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:43.866544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc40029-bd6d-416a-8501-1671baa7d381 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:43.903270 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81d448-8d3b-4335-bd97-35b7046a3eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:43.903883 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81d448-8d3b-4335-bd97-35b7046a3eac None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:43.904172 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81d448-8d3b-4335-bd97-35b7046a3eac None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:43.904525 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81d448-8d3b-4335-bd97-35b7046a3eac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:43.930350 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:43.979626 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81d448-8d3b-4335-bd97-35b7046a3eac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:43.981046 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81d448-8d3b-4335-bd97-35b7046a3eac None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:44.084275 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 321/648] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 20:33:44.093446 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d99de-47be-413a-9a94-1f0bc25c82a9 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:44.109302 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:44.216353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d99de-47be-413a-9a94-1f0bc25c82a9 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:44.252087 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ea9b1-70d2-48cc-961c-f5d10971a78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:44.252674 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ea9b1-70d2-48cc-961c-f5d10971a78e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:44.252959 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ea9b1-70d2-48cc-961c-f5d10971a78e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:44.253286 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ea9b1-70d2-48cc-961c-f5d10971a78e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:44.265007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ea9b1-70d2-48cc-961c-f5d10971a78e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:44.266463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ea9b1-70d2-48cc-961c-f5d10971a78e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:44.282027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-f20ea9b1-70d2-48cc-961c-f5d10971a78e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:44.282027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:44.282027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:44.282027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:44.282027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:44.282027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:44.282027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:44.282027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:44.282027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:44.282027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:44.282027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:44.282027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:44.282027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:44.282027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:44.282027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:44.282027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:44.282998 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:44.283863 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:44.283863 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:44.283863 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:44.283863 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 328/649] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:44.289260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81d448-8d3b-4335-bd97-35b7046a3eac None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:44.343100 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:44.391156 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81d448-8d3b-4335-bd97-35b7046a3eac None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:44.426075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda8695-596f-48d1-a434-523484fadf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:44.426672 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8695-596f-48d1-a434-523484fadf46 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:44.426948 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8695-596f-48d1-a434-523484fadf46 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:44.427217 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8695-596f-48d1-a434-523484fadf46 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:44.427849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda8695-596f-48d1-a434-523484fadf46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:44.428147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda8695-596f-48d1-a434-523484fadf46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:44.429811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda8695-596f-48d1-a434-523484fadf46 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:44.442013 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 322/650] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:44.448989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ea9b1-70d2-48cc-961c-f5d10971a78e None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:44.515459 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:44.556989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ea9b1-70d2-48cc-961c-f5d10971a78e None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:44.593119 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9b8da-8b5f-4fa7-9d7a-175287180a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:44.593890 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9b8da-8b5f-4fa7-9d7a-175287180a42 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:44.594180 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9b8da-8b5f-4fa7-9d7a-175287180a42 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:44.594460 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9b8da-8b5f-4fa7-9d7a-175287180a42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:44.602037 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9b8da-8b5f-4fa7-9d7a-175287180a42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:44.603478 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9b8da-8b5f-4fa7-9d7a-175287180a42 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:44.615039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-1db9b8da-8b5f-4fa7-9d7a-175287180a42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:44.615039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:44.615039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:44.615039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:44.615039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:44.615039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:44.615039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:44.615039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:44.615039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:44.615039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:44.615039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:44.615039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:44.615039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:33:44.615039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:33:44.615039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:44.615922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:44.616842 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:33:44.616842 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:33:44.616842 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:33:44.616842 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:33:44.616842 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:33:44.616842 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:33:44.616842 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:44.616842 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:44.616842 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 329/651] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:44.623979 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda8695-596f-48d1-a434-523484fadf46 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:44.736275 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda8695-596f-48d1-a434-523484fadf46 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:44.750889 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:44.774643 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a360e-ba7e-4a0d-b0a6-d53250c5104d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:44.775847 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a360e-ba7e-4a0d-b0a6-d53250c5104d None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:44.776329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a360e-ba7e-4a0d-b0a6-d53250c5104d None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:44.776828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a360e-ba7e-4a0d-b0a6-d53250c5104d None admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:44.777822 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a360e-ba7e-4a0d-b0a6-d53250c5104d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:44.778326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a360e-ba7e-4a0d-b0a6-d53250c5104d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:44.779949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a360e-ba7e-4a0d-b0a6-d53250c5104d None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:44.796030 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 323/652] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:33:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:44.801750 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9b8da-8b5f-4fa7-9d7a-175287180a42 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:44.911713 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9b8da-8b5f-4fa7-9d7a-175287180a42 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:44.939636 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:44.951530 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92437a06-da58-4472-879f-c562cbd10fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:44.952131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92437a06-da58-4472-879f-c562cbd10fe0 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:44.952437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92437a06-da58-4472-879f-c562cbd10fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:44.952714 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92437a06-da58-4472-879f-c562cbd10fe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:44.953494 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92437a06-da58-4472-879f-c562cbd10fe0 None admin] RBAC: Adding query filter params (role.id=9cc90aa0ccde4b75b7642101cbf45cf2, scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341, user.id=bc96ad30b91b46af92ff5b27a6b83abd) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:44.953806 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92437a06-da58-4472-879f-c562cbd10fe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:44.955231 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92437a06-da58-4472-879f-c562cbd10fe0 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:44.961885 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 330/653] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:33:44 2022] GET /identity/v3/role_assignments?user.id=bc96ad30b91b46af92ff5b27a6b83abd&scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341&role.id=9cc90aa0ccde4b75b7642101cbf45cf2 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:45.135345 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55177c1a-2267-4a79-85e7-66ef0ba022d5 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:45.135860 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55177c1a-2267-4a79-85e7-66ef0ba022d5 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:45.136186 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55177c1a-2267-4a79-85e7-66ef0ba022d5 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:45.137942 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 324/654] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:45.143716 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edf212-0717-48bc-b0e3-c61834da6ff4 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:45.144222 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edf212-0717-48bc-b0e3-c61834da6ff4 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:45.144297 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edf212-0717-48bc-b0e3-c61834da6ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:45.177347 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-69edf212-0717-48bc-b0e3-c61834da6ff4 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:45.178688 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-69edf212-0717-48bc-b0e3-c61834da6ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:45.255238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 331/655] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:33:45.348039 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc87d-94d3-468e-8137-eb5ff0456ed6 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:45.348387 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc87d-94d3-468e-8137-eb5ff0456ed6 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:45.348620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dc87d-94d3-468e-8137-eb5ff0456ed6 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:45.350227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 325/656] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:45.356082 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7359f26-64d5-4e70-9903-1683b96f93a4 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:45.356387 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7359f26-64d5-4e70-9903-1683b96f93a4 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:45.356663 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7359f26-64d5-4e70-9903-1683b96f93a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:45.375463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-d7359f26-64d5-4e70-9903-1683b96f93a4 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:45.376676 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-d7359f26-64d5-4e70-9903-1683b96f93a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:45.456456 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 332/657] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:45.592198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dc87d-94d3-468e-8137-eb5ff0456ed6 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:45.610112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeda3f-6632-44ac-b46d-5f6b903247fe None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:45.610408 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeda3f-6632-44ac-b46d-5f6b903247fe None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:45.610675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeda3f-6632-44ac-b46d-5f6b903247fe None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:45.612642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 333/658] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:45.618064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9add1-be6b-4ce2-88bc-80f465bf4f24 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:45.618446 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9add1-be6b-4ce2-88bc-80f465bf4f24 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:45.618812 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9add1-be6b-4ce2-88bc-80f465bf4f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:45.640772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-93d9add1-be6b-4ce2-88bc-80f465bf4f24 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:45.642103 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-93d9add1-be6b-4ce2-88bc-80f465bf4f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:45.694578 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:45.713677 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dc87d-94d3-468e-8137-eb5ff0456ed6 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:45.728814 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 334/659] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:45.750025 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074207c-4376-4181-b424-3b9ec3974b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:45.750651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074207c-4376-4181-b424-3b9ec3974b13 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:45.750925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074207c-4376-4181-b424-3b9ec3974b13 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:45.751197 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074207c-4376-4181-b424-3b9ec3974b13 None admin] PATH_INFO: `/v3/services/image` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:45.751768 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074207c-4376-4181-b424-3b9ec3974b13 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:45.753323 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074207c-4376-4181-b424-3b9ec3974b13 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-2074207c-4376-4181-b424-3b9ec3974b13 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:45.764620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:45.766923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:45.766923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:45.766923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:45.766923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:45.766923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:45.766923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:45.766923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:33:45.766923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:33:45.766923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:33:45.766923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:33:45.766923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:45.766923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:45.766923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:45.766923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:45.766923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:45.766923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:45.768632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:45.768632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:45.768632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:45.768632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:45.768632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:45.768632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:45.768632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:45.768632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:45.768632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:45.768632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:45.768632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:33:45.768632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:45.768632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 20:33:45.768632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:45.768632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 326/660] 10.222.0.61 () {56 vars in 1105 bytes} [Sat Sep 24 20:33:45 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:45.775030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9add1-be6b-4ce2-88bc-80f465bf4f24 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:45.794632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074207c-4376-4181-b424-3b9ec3974b13 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:45.833352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:45.907774 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9add1-be6b-4ce2-88bc-80f465bf4f24 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:45.922426 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074207c-4376-4181-b424-3b9ec3974b13 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:45.944826 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615b72d-e494-465d-bcd7-88d04c9de0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:45.946431 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615b72d-e494-465d-bcd7-88d04c9de0ca None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:45.946975 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615b72d-e494-465d-bcd7-88d04c9de0ca None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:45.947452 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615b72d-e494-465d-bcd7-88d04c9de0ca None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:45.948283 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615b72d-e494-465d-bcd7-88d04c9de0ca None admin] RBAC: Adding query filter params (name=image) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:45.948811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615b72d-e494-465d-bcd7-88d04c9de0ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:45.950621 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615b72d-e494-465d-bcd7-88d04c9de0ca None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:45.956373 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 335/661] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:45.962336 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615b72d-e494-465d-bcd7-88d04c9de0ca None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:45.965696 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719c180-b5ad-49e5-a93d-de72c1cfce75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:45.966678 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719c180-b5ad-49e5-a93d-de72c1cfce75 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:45.967178 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719c180-b5ad-49e5-a93d-de72c1cfce75 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:45.967711 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719c180-b5ad-49e5-a93d-de72c1cfce75 None admin] PATH_INFO: `/v3/services/network` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:45.968516 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719c180-b5ad-49e5-a93d-de72c1cfce75 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:45.970083 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719c180-b5ad-49e5-a93d-de72c1cfce75 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-2719c180-b5ad-49e5-a93d-de72c1cfce75 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:45.981124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:45.982130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:45.982130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:45.982130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:45.982130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:45.982130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:45.982130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:45.982130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:33:45.982130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:33:45.982130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:33:45.982130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:33:45.982130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:45.982130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:45.982130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:45.982130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:45.982130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:45.982130 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:45.982975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:45.982975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:45.982975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:45.982975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:45.982975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:45.982975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:45.982975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:45.982975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:45.982975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:45.982975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:45.982975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:33:45.982975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:45.982975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 20:33:45.982975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:45.986900 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 327/662] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:45 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:33:45.993194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719c180-b5ad-49e5-a93d-de72c1cfce75 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:46.016657 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:46.092740 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615b72d-e494-465d-bcd7-88d04c9de0ca None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:46.109041 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:46.112908 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719c180-b5ad-49e5-a93d-de72c1cfce75 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:46.129828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dded85-b9ad-429b-996d-9ebe214e8a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:46.130432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dded85-b9ad-429b-996d-9ebe214e8a3b None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:46.130711 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dded85-b9ad-429b-996d-9ebe214e8a3b None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:46.131019 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dded85-b9ad-429b-996d-9ebe214e8a3b None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:46.131641 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dded85-b9ad-429b-996d-9ebe214e8a3b None admin] RBAC: Adding query filter params (type=image) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:46.131941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dded85-b9ad-429b-996d-9ebe214e8a3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:46.133400 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dded85-b9ad-429b-996d-9ebe214e8a3b None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:46.139959 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 336/663] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:45 2022] GET /identity/v3/services?type=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:33:46.139959 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dded85-b9ad-429b-996d-9ebe214e8a3b None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:46.172009 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115ed9b-3deb-42de-bfc1-7d5c6b2235cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:46.173173 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115ed9b-3deb-42de-bfc1-7d5c6b2235cc None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:46.173454 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115ed9b-3deb-42de-bfc1-7d5c6b2235cc None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:46.173770 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115ed9b-3deb-42de-bfc1-7d5c6b2235cc None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:46.174377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115ed9b-3deb-42de-bfc1-7d5c6b2235cc None admin] RBAC: Adding query filter params (name=network) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:46.174684 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115ed9b-3deb-42de-bfc1-7d5c6b2235cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:46.176185 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115ed9b-3deb-42de-bfc1-7d5c6b2235cc None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:46.182581 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 328/664] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Sep 24 20:33:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:46.188081 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115ed9b-3deb-42de-bfc1-7d5c6b2235cc None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:46.293626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dded85-b9ad-429b-996d-9ebe214e8a3b None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:46.302285 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:46.326106 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115ed9b-3deb-42de-bfc1-7d5c6b2235cc None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:46.335244 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e45db9-535b-40d6-a792-073bbca5e8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:46.337261 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e45db9-535b-40d6-a792-073bbca5e8cc None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:46.337562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e45db9-535b-40d6-a792-073bbca5e8cc None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:46.337832 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e45db9-535b-40d6-a792-073bbca5e8cc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:46.338451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e45db9-535b-40d6-a792-073bbca5e8cc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:46.339861 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e45db9-535b-40d6-a792-073bbca5e8cc None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-75e45db9-535b-40d6-a792-073bbca5e8cc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:46.356488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:46.357574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:46.357574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:46.357574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:46.357574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:46.357574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:46.357574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:46.357574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:33:46.357574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:33:46.357574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:33:46.357574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:33:46.357574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:46.357574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:46.357574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:46.357574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:46.357574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:46.357574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:46.363509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:46.363509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:46.363509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:46.363509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:46.363509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:46.363509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:46.363509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:46.363509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:46.363509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:46.363509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:46.363509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:33:46.363509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:46.363509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 20:33:46.363509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:46.363509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 337/665] 10.222.0.61 () {56 vars in 1129 bytes} [Sat Sep 24 20:33:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:46.364316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e45db9-535b-40d6-a792-073bbca5e8cc None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:46.377184 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5057c-9e16-421d-a63b-0f56ff32db24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:46.377806 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5057c-9e16-421d-a63b-0f56ff32db24 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:46.378082 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5057c-9e16-421d-a63b-0f56ff32db24 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:46.378379 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5057c-9e16-421d-a63b-0f56ff32db24 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:46.378986 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5057c-9e16-421d-a63b-0f56ff32db24 None admin] RBAC: Adding query filter params (type=network) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:46.379294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5057c-9e16-421d-a63b-0f56ff32db24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:46.381109 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5057c-9e16-421d-a63b-0f56ff32db24 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:46.388451 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 329/666] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Sep 24 20:33:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:46.490235 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e45db9-535b-40d6-a792-073bbca5e8cc None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:46.530472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff26aa-454e-4e50-83b9-74056dc392b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:46.531404 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff26aa-454e-4e50-83b9-74056dc392b9 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:46.531868 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff26aa-454e-4e50-83b9-74056dc392b9 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:46.532324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff26aa-454e-4e50-83b9-74056dc392b9 None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:46.533284 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff26aa-454e-4e50-83b9-74056dc392b9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:46.533772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff26aa-454e-4e50-83b9-74056dc392b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:46.535365 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff26aa-454e-4e50-83b9-74056dc392b9 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:46.542005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 338/667] 10.222.0.61 () {56 vars in 1124 bytes} [Sat Sep 24 20:33:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:46.550549 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5057c-9e16-421d-a63b-0f56ff32db24 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:46.578763 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:46.658993 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5057c-9e16-421d-a63b-0f56ff32db24 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:46.694957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac8866-bb7c-4afc-afa2-59de581e5b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:46.696415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac8866-bb7c-4afc-afa2-59de581e5b66 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:46.696879 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac8866-bb7c-4afc-afa2-59de581e5b66 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:46.697364 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac8866-bb7c-4afc-afa2-59de581e5b66 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:46.698223 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac8866-bb7c-4afc-afa2-59de581e5b66 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:46.698709 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac8866-bb7c-4afc-afa2-59de581e5b66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:46.700240 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac8866-bb7c-4afc-afa2-59de581e5b66 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:46.705514 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 330/668] 10.222.0.61 () {56 vars in 1124 bytes} [Sat Sep 24 20:33:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:47.472447 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2423b5-6534-45c9-a11b-a6f8cc071c26 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:47.472447 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2423b5-6534-45c9-a11b-a6f8cc071c26 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:47.472447 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2423b5-6534-45c9-a11b-a6f8cc071c26 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:47.474255 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 339/669] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:47.498252 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9b29-d9b0-4d07-a423-30d4864e55c1 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:47.498835 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9b29-d9b0-4d07-a423-30d4864e55c1 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:47.498835 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f9b29-d9b0-4d07-a423-30d4864e55c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:47.533220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-902f9b29-d9b0-4d07-a423-30d4864e55c1 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:47.534497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-902f9b29-d9b0-4d07-a423-30d4864e55c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:47.608140 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 331/670] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:47.941616 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2423b5-6534-45c9-a11b-a6f8cc071c26 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:47.979869 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:48.050771 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2423b5-6534-45c9-a11b-a6f8cc071c26 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:48.087286 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa056365-e4a9-49f7-a63c-dbb13a0f8993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:48.088157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa056365-e4a9-49f7-a63c-dbb13a0f8993 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:48.088649 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa056365-e4a9-49f7-a63c-dbb13a0f8993 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:48.089090 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa056365-e4a9-49f7-a63c-dbb13a0f8993 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:48.099916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa056365-e4a9-49f7-a63c-dbb13a0f8993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:48.104899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-aa056365-e4a9-49f7-a63c-dbb13a0f8993 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:33:48.104899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:48.104899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:48.104899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:48.104899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:48.104899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:48.104899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:48.104899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:48.104899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:48.104899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:48.104899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:48.104899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:48.104899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:48.104899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:48.104899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:48.104899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:48.106027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:48.106027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:48.106027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:48.106027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:48.106027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:48.106027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:48.106027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:48.106027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:48.106027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:48.106027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:48.106027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:48.106027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:48.106027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:48.106027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:48.106027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:48.106027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:48.107062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:48.107062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:48.107062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:48.107062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:48.107062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:48.107062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:48.107062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:48.107062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:48.107062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:48.107062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:48.107062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:33:48.107062 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:48.109360 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 340/671] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:33:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:48.115306 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f9b29-d9b0-4d07-a423-30d4864e55c1 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:48.140358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:48.237166 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f9b29-d9b0-4d07-a423-30d4864e55c1 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:48.300755 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff9f2d-e023-449e-91f8-db1cb9113c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:48.301430 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9f2d-e023-449e-91f8-db1cb9113c28 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:48.301720 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9f2d-e023-449e-91f8-db1cb9113c28 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:48.302015 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff9f2d-e023-449e-91f8-db1cb9113c28 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:48.302706 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff9f2d-e023-449e-91f8-db1cb9113c28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:48.303018 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff9f2d-e023-449e-91f8-db1cb9113c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:48.304505 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff9f2d-e023-449e-91f8-db1cb9113c28 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:48.314650 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 332/672] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:48.320899 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa056365-e4a9-49f7-a63c-dbb13a0f8993 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:48.432385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa056365-e4a9-49f7-a63c-dbb13a0f8993 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:48.458442 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:48.464987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497317a2-ad16-493d-9741-9b6b201cdf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:48.465701 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497317a2-ad16-493d-9741-9b6b201cdf25 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:48.466444 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497317a2-ad16-493d-9741-9b6b201cdf25 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:48.466444 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497317a2-ad16-493d-9741-9b6b201cdf25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:48.477982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497317a2-ad16-493d-9741-9b6b201cdf25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:48.479436 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497317a2-ad16-493d-9741-9b6b201cdf25 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:48.495955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-497317a2-ad16-493d-9741-9b6b201cdf25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:48.495955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:48.495955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:48.495955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:48.495955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:48.495955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:48.495955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:48.495955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:48.495955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:48.495955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:48.495955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:48.495955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:48.495955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:48.495955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:48.495955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:48.495955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:48.496937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:48.497826 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:48.497826 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:48.497826 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:48.497826 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 341/673] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:48.503000 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff9f2d-e023-449e-91f8-db1cb9113c28 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:48.609138 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:48.620608 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff9f2d-e023-449e-91f8-db1cb9113c28 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:48.665256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379d568-b553-40cd-bbee-424683ab1230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:48.665955 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379d568-b553-40cd-bbee-424683ab1230 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:48.666545 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379d568-b553-40cd-bbee-424683ab1230 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:48.666823 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379d568-b553-40cd-bbee-424683ab1230 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:48.667460 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379d568-b553-40cd-bbee-424683ab1230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:48.667763 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379d568-b553-40cd-bbee-424683ab1230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:48.669152 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379d568-b553-40cd-bbee-424683ab1230 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:48.683350 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 333/674] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:33:48.688831 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497317a2-ad16-493d-9741-9b6b201cdf25 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:48.723237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb740d-0863-4c85-a2d7-6ef4aeab5bc3 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:48.723563 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb740d-0863-4c85-a2d7-6ef4aeab5bc3 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:48.723867 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb740d-0863-4c85-a2d7-6ef4aeab5bc3 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:48.725634 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 334/675] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:33:48.730558 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da840b4d-8c97-44fa-ba86-8dd4d155c701 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:48.730845 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da840b4d-8c97-44fa-ba86-8dd4d155c701 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:48.731119 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da840b4d-8c97-44fa-ba86-8dd4d155c701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:48.762626 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-da840b4d-8c97-44fa-ba86-8dd4d155c701 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:48.763766 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-da840b4d-8c97-44fa-ba86-8dd4d155c701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:48.884366 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 335/676] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:48.888361 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497317a2-ad16-493d-9741-9b6b201cdf25 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:48.923776 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8b9d6-f904-4600-8e24-312d054bad4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:48.924686 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8b9d6-f904-4600-8e24-312d054bad4e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:48.924979 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8b9d6-f904-4600-8e24-312d054bad4e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:48.925246 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8b9d6-f904-4600-8e24-312d054bad4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:48.934429 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8b9d6-f904-4600-8e24-312d054bad4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:48.935919 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8b9d6-f904-4600-8e24-312d054bad4e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:48.949461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-57e8b9d6-f904-4600-8e24-312d054bad4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 20:33:48.949461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:48.949461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:48.949461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:48.949461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:48.949461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:48.949461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:48.949461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:48.949461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:48.949461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:48.949461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:48.949461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:48.949461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:33:48.949461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:33:48.949461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:33:48.949461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:48.950501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:48.951437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:48.951437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:48.951437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:33:48.951437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:33:48.951437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:33:48.951437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:33:48.951437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:33:48.951437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:33:48.951437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 20:33:48.951437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:48.951437 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 342/677] 10.222.0.61 () {56 vars in 1093 bytes} [Sat Sep 24 20:33:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:48.957079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da840b4d-8c97-44fa-ba86-8dd4d155c701 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:49.035914 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:49.037258 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ef3c3-57f8-434d-a95a-3b2279bcf4f4 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:49.037258 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ef3c3-57f8-434d-a95a-3b2279bcf4f4 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:49.037258 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ef3c3-57f8-434d-a95a-3b2279bcf4f4 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:49.040241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 343/678] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:49.045744 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b85d3e-fd74-4e9b-9729-c50f49f8281b None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:49.046913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b85d3e-fd74-4e9b-9729-c50f49f8281b None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:49.047612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b85d3e-fd74-4e9b-9729-c50f49f8281b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:49.062058 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:49.066305 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da840b4d-8c97-44fa-ba86-8dd4d155c701 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:49.069028 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-12b85d3e-fd74-4e9b-9729-c50f49f8281b None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:49.071548 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-12b85d3e-fd74-4e9b-9729-c50f49f8281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:49.114599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7a947-70e3-429b-81cd-d5b4b47c3e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:49.115215 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7a947-70e3-429b-81cd-d5b4b47c3e0e None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:49.115497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7a947-70e3-429b-81cd-d5b4b47c3e0e None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:49.116038 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f7a947-70e3-429b-81cd-d5b4b47c3e0e None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:49.117479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7a947-70e3-429b-81cd-d5b4b47c3e0e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:49.117744 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7a947-70e3-429b-81cd-d5b4b47c3e0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:49.119843 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f7a947-70e3-429b-81cd-d5b4b47c3e0e None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:49.142204 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 336/679] 10.222.0.61 () {56 vars in 1133 bytes} [Sat Sep 24 20:33:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:49.147998 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7a947-70e3-429b-81cd-d5b4b47c3e0e None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:49.174097 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 344/680] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 20:33:49.208816 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b85d3e-fd74-4e9b-9729-c50f49f8281b None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:49.271806 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f7a947-70e3-429b-81cd-d5b4b47c3e0e None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:49.302811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:49.309723 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0aadb2-2a68-4794-bd7f-d3a184353dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:49.310287 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0aadb2-2a68-4794-bd7f-d3a184353dea None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:49.310617 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0aadb2-2a68-4794-bd7f-d3a184353dea None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:49.310829 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0aadb2-2a68-4794-bd7f-d3a184353dea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:49.322026 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0aadb2-2a68-4794-bd7f-d3a184353dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:49.323515 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0aadb2-2a68-4794-bd7f-d3a184353dea None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:49.339637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-de0aadb2-2a68-4794-bd7f-d3a184353dea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:49.339637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:49.339637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:49.339637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:49.339637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:49.339637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:49.339637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:49.339637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:49.339637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:49.339637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:49.339637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:49.339637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:49.339637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:49.339637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:49.339637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:49.339637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:49.340640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:49.341552 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:49.341552 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:49.341552 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:49.344921 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b85d3e-fd74-4e9b-9729-c50f49f8281b None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:49.345504 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 337/681] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:49.346344 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0aadb2-2a68-4794-bd7f-d3a184353dea None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:49.388898 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77923b-2d8b-4ffd-b513-5b60ad52d4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:49.389638 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77923b-2d8b-4ffd-b513-5b60ad52d4e4 None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:49.389919 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77923b-2d8b-4ffd-b513-5b60ad52d4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:49.390192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77923b-2d8b-4ffd-b513-5b60ad52d4e4 None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:49.390832 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77923b-2d8b-4ffd-b513-5b60ad52d4e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:49.392194 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77923b-2d8b-4ffd-b513-5b60ad52d4e4 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:49.397399 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:49.410720 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 345/682] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Sep 24 20:33:49 2022] POST /identity/v3/services => generated 242 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:33:49.412212 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3534103-95fd-449f-8ee9-c3e9031511b6 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:49.412734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3534103-95fd-449f-8ee9-c3e9031511b6 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:49.413152 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3534103-95fd-449f-8ee9-c3e9031511b6 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:49.414554 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 346/683] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:49.420912 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946e527-04e7-4af7-a7fd-4012cdcff8ff None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:49.421406 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946e527-04e7-4af7-a7fd-4012cdcff8ff None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:49.421830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946e527-04e7-4af7-a7fd-4012cdcff8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:49.443630 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-2946e527-04e7-4af7-a7fd-4012cdcff8ff None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:49.444955 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-2946e527-04e7-4af7-a7fd-4012cdcff8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:49.470009 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0aadb2-2a68-4794-bd7f-d3a184353dea None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:49.524318 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdc8c7-ba3a-4119-94a2-3e7d8e3e30c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:49.525049 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdc8c7-ba3a-4119-94a2-3e7d8e3e30c6 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:49.525284 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdc8c7-ba3a-4119-94a2-3e7d8e3e30c6 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:49.525506 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdc8c7-ba3a-4119-94a2-3e7d8e3e30c6 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:49.526164 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdc8c7-ba3a-4119-94a2-3e7d8e3e30c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:49.526473 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdc8c7-ba3a-4119-94a2-3e7d8e3e30c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:49.527876 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdc8c7-ba3a-4119-94a2-3e7d8e3e30c6 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:49.531070 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 347/684] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:49 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 20:33:49.531995 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946e527-04e7-4af7-a7fd-4012cdcff8ff None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:49.544299 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 338/685] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:49.549472 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdc8c7-ba3a-4119-94a2-3e7d8e3e30c6 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:49.606893 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:49.645217 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946e527-04e7-4af7-a7fd-4012cdcff8ff None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:49.676425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:49.690641 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d988b7-80db-481d-9a23-e9ee2b685adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:49.691547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d988b7-80db-481d-9a23-e9ee2b685adf None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:49.692006 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d988b7-80db-481d-9a23-e9ee2b685adf None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:49.692514 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d988b7-80db-481d-9a23-e9ee2b685adf None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:49.692889 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdc8c7-ba3a-4119-94a2-3e7d8e3e30c6 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:49.693558 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d988b7-80db-481d-9a23-e9ee2b685adf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:49.695621 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d988b7-80db-481d-9a23-e9ee2b685adf None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:49.712810 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 348/686] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Sep 24 20:33:49 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:33:49.743759 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c246781-bcc7-4cc2-87ed-f687f3c3a0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:49.744516 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c246781-bcc7-4cc2-87ed-f687f3c3a0f8 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:49.744800 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c246781-bcc7-4cc2-87ed-f687f3c3a0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:49.745116 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c246781-bcc7-4cc2-87ed-f687f3c3a0f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:49.753482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c246781-bcc7-4cc2-87ed-f687f3c3a0f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:49.755075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c246781-bcc7-4cc2-87ed-f687f3c3a0f8 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:49.769237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-8c246781-bcc7-4cc2-87ed-f687f3c3a0f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:49.769237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:49.769237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:49.769237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:49.769237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:49.769237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:49.769237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:49.769237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:49.769237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:49.769237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:49.769237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:49.769237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:49.769237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:33:49.769237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:33:49.769237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:49.770183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:49.771682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:33:49.771682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:33:49.771682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:33:49.771682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:33:49.771682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:33:49.771682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:33:49.771682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:49.771682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:49.771682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 339/687] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:49.777465 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d988b7-80db-481d-9a23-e9ee2b685adf None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:49.863248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c246781-bcc7-4cc2-87ed-f687f3c3a0f8 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:49.912847 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d988b7-80db-481d-9a23-e9ee2b685adf None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:49.952532 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7fc7c-f8ee-4e5d-be6c-e4f26b228f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:49.953143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7fc7c-f8ee-4e5d-be6c-e4f26b228f27 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:49.953423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7fc7c-f8ee-4e5d-be6c-e4f26b228f27 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:49.953697 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7fc7c-f8ee-4e5d-be6c-e4f26b228f27 None admin] PATH_INFO: `/v3/projects` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:49.954388 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7fc7c-f8ee-4e5d-be6c-e4f26b228f27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:49.954697 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7fc7c-f8ee-4e5d-be6c-e4f26b228f27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:49.956110 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7fc7c-f8ee-4e5d-be6c-e4f26b228f27 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:49.968687 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 349/688] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:33:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:49.977354 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7fc7c-f8ee-4e5d-be6c-e4f26b228f27 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:49.980443 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:49.988643 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c246781-bcc7-4cc2-87ed-f687f3c3a0f8 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:50.034431 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c598c7-69e4-420f-a917-df3896434165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:50.035060 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c598c7-69e4-420f-a917-df3896434165 None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:50.035554 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c598c7-69e4-420f-a917-df3896434165 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:50.035663 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c598c7-69e4-420f-a917-df3896434165 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:50.036229 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c598c7-69e4-420f-a917-df3896434165 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:50.037492 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:50.037671 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c598c7-69e4-420f-a917-df3896434165 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:50.064365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 340/689] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Sep 24 20:33:49 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:33:50.107427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7fc7c-f8ee-4e5d-be6c-e4f26b228f27 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:50.156807 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc86c1-27e9-47a4-a257-0360d5a649e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:50.157403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc86c1-27e9-47a4-a257-0360d5a649e9 None admin] REQUEST_METHOD: `PUT` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:50.157682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc86c1-27e9-47a4-a257-0360d5a649e9 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:50.157957 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc86c1-27e9-47a4-a257-0360d5a649e9 None admin] PATH_INFO: `/v3/projects/6e446dc5c12d49bca59e6e8c8ad90341/users/bc96ad30b91b46af92ff5b27a6b83abd/roles/9cc90aa0ccde4b75b7642101cbf45cf2` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:50.160147 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc86c1-27e9-47a4-a257-0360d5a649e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e446dc5c12d49bca59e6e8c8ad90341, user_id=bc96ad30b91b46af92ff5b27a6b83abd, role_id=9cc90aa0ccde4b75b7642101cbf45cf2)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:50.161835 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc86c1-27e9-47a4-a257-0360d5a649e9 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:50.181673 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 350/690] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Sep 24 20:33:49 2022] PUT /identity/v3/projects/6e446dc5c12d49bca59e6e8c8ad90341/users/bc96ad30b91b46af92ff5b27a6b83abd/roles/9cc90aa0ccde4b75b7642101cbf45cf2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:33:52.013358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf796cf5-dd6e-4a06-aa08-78bdad409b48 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:52.014228 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf796cf5-dd6e-4a06-aa08-78bdad409b48 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:52.014738 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf796cf5-dd6e-4a06-aa08-78bdad409b48 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:52.016440 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 341/691] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:52.022167 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438e795-b28b-4e05-b090-fda123bced1c None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:52.023036 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438e795-b28b-4e05-b090-fda123bced1c None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:52.023512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438e795-b28b-4e05-b090-fda123bced1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:52.048742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-e438e795-b28b-4e05-b090-fda123bced1c None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:52.050097 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-e438e795-b28b-4e05-b090-fda123bced1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:52.124910 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 351/692] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:52 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:33:52.296950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8eb7c-7251-4cfe-ba60-508e0e626940 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:52.297605 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8eb7c-7251-4cfe-ba60-508e0e626940 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:52.298082 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8eb7c-7251-4cfe-ba60-508e0e626940 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:52.299849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 342/693] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:52.306436 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d81f29-fd96-427f-aa71-d9570bf87424 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:52.306725 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d81f29-fd96-427f-aa71-d9570bf87424 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:52.307002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d81f29-fd96-427f-aa71-d9570bf87424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:52.328783 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-62d81f29-fd96-427f-aa71-d9570bf87424 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:52.329967 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-62d81f29-fd96-427f-aa71-d9570bf87424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:52.353845 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:52.403800 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 352/694] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:52 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:33:52.482523 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8eb7c-7251-4cfe-ba60-508e0e626940 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:52.549477 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13690a-cfa5-4a9d-b45a-18b27b466b98 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:52.549775 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13690a-cfa5-4a9d-b45a-18b27b466b98 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:52.549956 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13690a-cfa5-4a9d-b45a-18b27b466b98 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:52.551522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 353/695] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:52.557103 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e5739-a8ab-456b-9391-9bed145a03e6 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:52.557411 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e5739-a8ab-456b-9391-9bed145a03e6 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:52.557679 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e5739-a8ab-456b-9391-9bed145a03e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:52.576122 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-c32e5739-a8ab-456b-9391-9bed145a03e6 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:52.577340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-c32e5739-a8ab-456b-9391-9bed145a03e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:52.595957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8eb7c-7251-4cfe-ba60-508e0e626940 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:52.636833 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcf17f-dcec-49c5-9719-168282fc9cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:52.637992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcf17f-dcec-49c5-9719-168282fc9cac None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:52.638284 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcf17f-dcec-49c5-9719-168282fc9cac None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:52.638569 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcf17f-dcec-49c5-9719-168282fc9cac None admin] PATH_INFO: `/v3/services/image` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:52.639156 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcf17f-dcec-49c5-9719-168282fc9cac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:52.640859 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcf17f-dcec-49c5-9719-168282fc9cac None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-95fcf17f-dcec-49c5-9719-168282fc9cac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:52.651386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:52.652442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:52.652442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:52.652442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:52.652442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:52.652442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:52.652442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:52.652442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:33:52.652442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:33:52.652442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:33:52.652442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:33:52.652442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:52.652442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:52.652442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:52.652442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:52.652442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:52.652442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:52.653298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:52.653298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:52.653298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:52.653298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:52.653298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:52.653298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:52.653298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:52.653298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:52.653298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:52.653298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:52.653298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:33:52.653298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:52.653298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 20:33:52.653298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:52.653298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 343/696] 10.222.0.61 () {56 vars in 1105 bytes} [Sat Sep 24 20:33:52 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:52.660561 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 354/697] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:52 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:33:52.665342 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcf17f-dcec-49c5-9719-168282fc9cac None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:52.689213 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:52.703354 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7640bd-d967-4f4b-bcbe-bd169e02af59 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:52.703642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7640bd-d967-4f4b-bcbe-bd169e02af59 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:52.703923 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7640bd-d967-4f4b-bcbe-bd169e02af59 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:52.705411 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 355/698] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:52.711222 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4a47f-e559-483a-b863-d3f3c45f2f72 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:52.711506 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4a47f-e559-483a-b863-d3f3c45f2f72 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:52.711782 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4a47f-e559-483a-b863-d3f3c45f2f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:52.733817 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-01f4a47f-e559-483a-b863-d3f3c45f2f72 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:52.735005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-01f4a47f-e559-483a-b863-d3f3c45f2f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:52.787393 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcf17f-dcec-49c5-9719-168282fc9cac None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:52.806227 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 356/699] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:52 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 20:33:52.807087 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4a47f-e559-483a-b863-d3f3c45f2f72 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:52.827263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:52.831521 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9621f0-8709-4fe5-8840-2b347b3b8303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:52.832502 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9621f0-8709-4fe5-8840-2b347b3b8303 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:52.833033 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9621f0-8709-4fe5-8840-2b347b3b8303 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:52.833398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9621f0-8709-4fe5-8840-2b347b3b8303 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:52.834860 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9621f0-8709-4fe5-8840-2b347b3b8303 None admin] RBAC: Adding query filter params (name=image) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:52.836490 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9621f0-8709-4fe5-8840-2b347b3b8303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:52.838043 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9621f0-8709-4fe5-8840-2b347b3b8303 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:52.844407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 344/700] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:52.852330 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9621f0-8709-4fe5-8840-2b347b3b8303 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:52.918341 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4a47f-e559-483a-b863-d3f3c45f2f72 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:52.938520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:52.953511 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782797ea-fa7d-432b-a9bb-463787519c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:52.954147 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782797ea-fa7d-432b-a9bb-463787519c9b None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:52.954422 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782797ea-fa7d-432b-a9bb-463787519c9b None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:52.954697 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782797ea-fa7d-432b-a9bb-463787519c9b None admin] PATH_INFO: `/v3/services/network` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:52.955420 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782797ea-fa7d-432b-a9bb-463787519c9b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:52.956653 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782797ea-fa7d-432b-a9bb-463787519c9b None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:52.958422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9621f0-8709-4fe5-8840-2b347b3b8303 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-782797ea-fa7d-432b-a9bb-463787519c9b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:52.965723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:52.966914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:52.966914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:52.966914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:52.966914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:52.966914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:52.966914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:52.966914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:33:52.966914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:33:52.966914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:33:52.966914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:33:52.966914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:52.966914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:52.966914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:52.966914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:52.966914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:52.966914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:52.967895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:52.967895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:52.967895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:52.967895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:52.967895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:52.967895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:52.967895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:52.967895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:52.967895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:52.967895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:52.967895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:33:52.967895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:52.967895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 20:33:52.967895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:52.971605 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 357/701] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:52 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:52.972458 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782797ea-fa7d-432b-a9bb-463787519c9b None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:53.000297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ded26-77f0-4bae-af83-e6fcd4145803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:53.001242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ded26-77f0-4bae-af83-e6fcd4145803 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:53.001759 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ded26-77f0-4bae-af83-e6fcd4145803 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:53.002169 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ded26-77f0-4bae-af83-e6fcd4145803 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:53.002967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ded26-77f0-4bae-af83-e6fcd4145803 None admin] RBAC: Adding query filter params (type=image) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:53.003458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ded26-77f0-4bae-af83-e6fcd4145803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:53.005228 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ded26-77f0-4bae-af83-e6fcd4145803 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:53.010444 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 345/702] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:53.011499 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ded26-77f0-4bae-af83-e6fcd4145803 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:53.060964 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:53.080167 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782797ea-fa7d-432b-a9bb-463787519c9b None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:53.115854 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38690f9e-572a-44e2-9a12-69b236308514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:53.116456 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38690f9e-572a-44e2-9a12-69b236308514 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:53.117276 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38690f9e-572a-44e2-9a12-69b236308514 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:53.117551 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38690f9e-572a-44e2-9a12-69b236308514 None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:53.117747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ded26-77f0-4bae-af83-e6fcd4145803 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:53.118179 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38690f9e-572a-44e2-9a12-69b236308514 None admin] RBAC: Adding query filter params (name=network) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:53.118469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38690f9e-572a-44e2-9a12-69b236308514 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:53.119828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38690f9e-572a-44e2-9a12-69b236308514 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:53.128796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 358/703] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Sep 24 20:33:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:53.128796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38690f9e-572a-44e2-9a12-69b236308514 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:53.159643 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64376f6c-2925-4e13-94ee-b8741009e5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:53.160284 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64376f6c-2925-4e13-94ee-b8741009e5f2 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:53.162971 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64376f6c-2925-4e13-94ee-b8741009e5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:53.162971 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64376f6c-2925-4e13-94ee-b8741009e5f2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:53.162971 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64376f6c-2925-4e13-94ee-b8741009e5f2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:53.162971 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64376f6c-2925-4e13-94ee-b8741009e5f2 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-64376f6c-2925-4e13-94ee-b8741009e5f2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:53.173352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:53.174335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:53.174335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:53.174335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:53.174335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:53.174335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:53.174335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:53.174335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:33:53.174335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:33:53.174335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:33:53.174335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:33:53.174335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:53.174335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:53.174335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:53.174335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:53.174335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:53.174335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:53.175174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:53.175174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:53.175174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:53.175174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:53.175174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:53.175174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:53.175174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:53.175174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:53.175174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:53.175174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:53.175174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:33:53.175174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:53.175174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 20:33:53.175174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:53.175174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 346/704] 10.222.0.61 () {56 vars in 1129 bytes} [Sat Sep 24 20:33:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:53.175951 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64376f6c-2925-4e13-94ee-b8741009e5f2 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:53.190534 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:53.232699 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38690f9e-572a-44e2-9a12-69b236308514 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:53.264224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713b2ec-892c-4692-80bc-372356ce4ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:53.264922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713b2ec-892c-4692-80bc-372356ce4ac1 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:53.265197 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713b2ec-892c-4692-80bc-372356ce4ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:53.265474 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713b2ec-892c-4692-80bc-372356ce4ac1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:53.266160 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713b2ec-892c-4692-80bc-372356ce4ac1 None admin] RBAC: Adding query filter params (interface=public, service_id=cbda5ba9ebe24ba6abff87767c2f87c4, region_id=RegionOne) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:53.266460 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713b2ec-892c-4692-80bc-372356ce4ac1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:53.267801 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713b2ec-892c-4692-80bc-372356ce4ac1 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:53.274342 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64376f6c-2925-4e13-94ee-b8741009e5f2 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:53.275972 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 359/705] 10.222.0.61 () {56 vars in 1251 bytes} [Sat Sep 24 20:33:53 2022] GET /identity/v3/endpoints?service_id=cbda5ba9ebe24ba6abff87767c2f87c4&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:53.277077 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713b2ec-892c-4692-80bc-372356ce4ac1 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:53.290807 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:53.308612 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a1405-5631-4f0e-a375-97b413037281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:53.309243 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1405-5631-4f0e-a375-97b413037281 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:53.309527 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1405-5631-4f0e-a375-97b413037281 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:53.309804 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a1405-5631-4f0e-a375-97b413037281 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:53.310440 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a1405-5631-4f0e-a375-97b413037281 None admin] RBAC: Adding query filter params (type=network) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:53.310747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a1405-5631-4f0e-a375-97b413037281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:53.312169 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4a1405-5631-4f0e-a375-97b413037281 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:53.317031 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 347/706] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Sep 24 20:33:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:53.317809 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a1405-5631-4f0e-a375-97b413037281 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:53.376258 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713b2ec-892c-4692-80bc-372356ce4ac1 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:53.393615 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:53.409520 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9627b93-253c-4cf5-b009-b8bf6130e583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:53.410142 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9627b93-253c-4cf5-b009-b8bf6130e583 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:53.410422 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9627b93-253c-4cf5-b009-b8bf6130e583 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:53.410696 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9627b93-253c-4cf5-b009-b8bf6130e583 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:53.418014 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a1405-5631-4f0e-a375-97b413037281 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:53.421211 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9627b93-253c-4cf5-b009-b8bf6130e583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:33:53.426401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-c9627b93-253c-4cf5-b009-b8bf6130e583 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:33:53.426401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:53.426401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:53.426401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:53.426401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:53.426401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:53.426401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:53.426401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:53.426401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:53.426401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:53.426401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:53.426401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:53.426401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:33:53.426401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:33:53.426401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:33:53.426401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:33:53.427320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:33:53.427320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:33:53.427320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:33:53.427320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:33:53.427320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:53.427320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:53.427320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:53.427320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:53.427320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:53.427320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:53.427320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:53.427320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:53.427320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:53.427320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:53.427320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:53.427320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:53.428158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:53.428158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:53.428158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:53.428158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:53.428158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:33:53.428158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:33:53.428158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:33:53.428158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:33:53.428158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:33:53.428158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:33:53.428158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:33:53.428158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:53.428158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 360/707] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:33:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:53.428893 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9627b93-253c-4cf5-b009-b8bf6130e583 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:53.456096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe3020-28c1-4ae7-97fe-ad7b7fe96785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:53.456736 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe3020-28c1-4ae7-97fe-ad7b7fe96785 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:53.457015 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe3020-28c1-4ae7-97fe-ad7b7fe96785 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:53.457291 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe3020-28c1-4ae7-97fe-ad7b7fe96785 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:53.457908 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe3020-28c1-4ae7-97fe-ad7b7fe96785 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:53.458213 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe3020-28c1-4ae7-97fe-ad7b7fe96785 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:53.459649 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe3020-28c1-4ae7-97fe-ad7b7fe96785 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:53.464118 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 348/708] 10.222.0.61 () {56 vars in 1124 bytes} [Sat Sep 24 20:33:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:53.464930 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe3020-28c1-4ae7-97fe-ad7b7fe96785 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:53.502512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:53.534144 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9627b93-253c-4cf5-b009-b8bf6130e583 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:53.563413 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe3020-28c1-4ae7-97fe-ad7b7fe96785 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:53.567606 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e011e-4586-4c70-8bf1-bd4dedc4c91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:53.568211 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e011e-4586-4c70-8bf1-bd4dedc4c91e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:53.568525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e011e-4586-4c70-8bf1-bd4dedc4c91e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:53.568803 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e011e-4586-4c70-8bf1-bd4dedc4c91e None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:53.569408 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e011e-4586-4c70-8bf1-bd4dedc4c91e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:53.571326 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e011e-4586-4c70-8bf1-bd4dedc4c91e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:53.576603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 361/709] 10.222.0.61 () {56 vars in 1087 bytes} [Sat Sep 24 20:33:53 2022] GET /identity/v3/services => generated 1002 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:33:53.582028 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e011e-4586-4c70-8bf1-bd4dedc4c91e None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:53.615831 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bdd3c-ed6f-40e4-9ba9-ec50416bcd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:53.616496 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bdd3c-ed6f-40e4-9ba9-ec50416bcd20 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:53.616817 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bdd3c-ed6f-40e4-9ba9-ec50416bcd20 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:53.617279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bdd3c-ed6f-40e4-9ba9-ec50416bcd20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:53.618918 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bdd3c-ed6f-40e4-9ba9-ec50416bcd20 None admin] RBAC: Adding query filter params (interface=public, service_id=0ed461cc780140c3ae07b699a362484b, region_id=RegionOne) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:53.619248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bdd3c-ed6f-40e4-9ba9-ec50416bcd20 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:53.620679 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bdd3c-ed6f-40e4-9ba9-ec50416bcd20 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:53.635825 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 349/710] 10.222.0.61 () {56 vars in 1251 bytes} [Sat Sep 24 20:33:53 2022] GET /identity/v3/endpoints?service_id=0ed461cc780140c3ae07b699a362484b&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:53.635825 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bdd3c-ed6f-40e4-9ba9-ec50416bcd20 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:53.638795 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:53.693860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e011e-4586-4c70-8bf1-bd4dedc4c91e None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:53.729522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68193f90-d158-4b62-a904-5062de80c5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:53.730144 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68193f90-d158-4b62-a904-5062de80c5a1 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:53.730426 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68193f90-d158-4b62-a904-5062de80c5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:53.730696 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68193f90-d158-4b62-a904-5062de80c5a1 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:53.731364 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68193f90-d158-4b62-a904-5062de80c5a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:53.731669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68193f90-d158-4b62-a904-5062de80c5a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:53.733091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68193f90-d158-4b62-a904-5062de80c5a1 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:53.734682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:53.744080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 362/711] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:33:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:53.745003 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68193f90-d158-4b62-a904-5062de80c5a1 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:53.772093 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bdd3c-ed6f-40e4-9ba9-ec50416bcd20 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:53.811857 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4398aab-5765-4655-a354-42782a66170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:53.812593 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4398aab-5765-4655-a354-42782a66170d None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:53.812884 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4398aab-5765-4655-a354-42782a66170d None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:53.813161 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4398aab-5765-4655-a354-42782a66170d None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:53.814016 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4398aab-5765-4655-a354-42782a66170d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:53.814277 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4398aab-5765-4655-a354-42782a66170d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:53.816145 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4398aab-5765-4655-a354-42782a66170d None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:53.821193 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 350/712] 10.222.0.61 () {56 vars in 1124 bytes} [Sat Sep 24 20:33:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:53.822075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4398aab-5765-4655-a354-42782a66170d None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:53.861810 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68193f90-d158-4b62-a904-5062de80c5a1 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:53.895402 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:53.901448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de339ec9-de3b-4d3d-86ce-8c8aa2a9cde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:53.902065 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de339ec9-de3b-4d3d-86ce-8c8aa2a9cde1 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:53.902394 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de339ec9-de3b-4d3d-86ce-8c8aa2a9cde1 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:53.902675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de339ec9-de3b-4d3d-86ce-8c8aa2a9cde1 None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:53.903280 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de339ec9-de3b-4d3d-86ce-8c8aa2a9cde1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:53.904671 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de339ec9-de3b-4d3d-86ce-8c8aa2a9cde1 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:53.920374 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 363/713] 10.222.0.61 () {56 vars in 1087 bytes} [Sat Sep 24 20:33:53 2022] GET /identity/v3/services => generated 1002 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:33:53.920374 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de339ec9-de3b-4d3d-86ce-8c8aa2a9cde1 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:53.932366 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4398aab-5765-4655-a354-42782a66170d None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:53.973578 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719a67c-8aa5-4959-9b35-3e8cac91ad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:53.974221 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719a67c-8aa5-4959-9b35-3e8cac91ad19 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:53.974501 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719a67c-8aa5-4959-9b35-3e8cac91ad19 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:53.974794 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719a67c-8aa5-4959-9b35-3e8cac91ad19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:53.988675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719a67c-8aa5-4959-9b35-3e8cac91ad19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:53.990215 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719a67c-8aa5-4959-9b35-3e8cac91ad19 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:54.008296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-c719a67c-8aa5-4959-9b35-3e8cac91ad19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:54.008296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:54.008296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:54.008296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:54.008296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:54.008296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:54.008296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:54.008296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:54.008296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:54.008296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:54.008296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:54.008296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:54.008296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:54.008296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:54.008296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:54.008296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:54.009520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:54.010607 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:54.010607 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:54.010607 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:54.010607 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 351/714] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:54.011269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:54.017354 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719a67c-8aa5-4959-9b35-3e8cac91ad19 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:54.057739 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de339ec9-de3b-4d3d-86ce-8c8aa2a9cde1 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:54.249972 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bf410-ea63-4738-940e-7e4242279a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:54.251018 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bf410-ea63-4738-940e-7e4242279a4f None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:54.251395 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bf410-ea63-4738-940e-7e4242279a4f None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:54.251884 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bf410-ea63-4738-940e-7e4242279a4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:54.253532 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bf410-ea63-4738-940e-7e4242279a4f None admin] RBAC: Adding query filter params (interface=public, service_id=0898061b1f2e4a51bf0a2358dc75050c, region_id=RegionOne) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:54.253951 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bf410-ea63-4738-940e-7e4242279a4f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:54.255425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bf410-ea63-4738-940e-7e4242279a4f None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:54.262364 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 364/715] 10.222.0.61 () {56 vars in 1251 bytes} [Sat Sep 24 20:33:53 2022] GET /identity/v3/endpoints?service_id=0898061b1f2e4a51bf0a2358dc75050c&interface=public®ion_id=RegionOne => generated 194 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:54.267836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bf410-ea63-4738-940e-7e4242279a4f None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:54.299500 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719a67c-8aa5-4959-9b35-3e8cac91ad19 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:54.332686 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:54.349010 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1363bd-b020-47fc-b759-fe8b58c8e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:54.349905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1363bd-b020-47fc-b759-fe8b58c8e199 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:54.351154 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1363bd-b020-47fc-b759-fe8b58c8e199 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:54.351154 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1363bd-b020-47fc-b759-fe8b58c8e199 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:54.351532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1363bd-b020-47fc-b759-fe8b58c8e199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:54.351991 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1363bd-b020-47fc-b759-fe8b58c8e199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:54.354667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1363bd-b020-47fc-b759-fe8b58c8e199 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:54.371663 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 352/716] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:54.376751 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1363bd-b020-47fc-b759-fe8b58c8e199 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:54.384593 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bf410-ea63-4738-940e-7e4242279a4f None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:54.413035 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:54.429443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc6c70-b6c5-460b-a198-57675de999e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:54.430024 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc6c70-b6c5-460b-a198-57675de999e4 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:54.430302 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc6c70-b6c5-460b-a198-57675de999e4 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:54.430575 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc6c70-b6c5-460b-a198-57675de999e4 None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:54.431181 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc6c70-b6c5-460b-a198-57675de999e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:54.432999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc6c70-b6c5-460b-a198-57675de999e4 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:54.445796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 365/717] 10.222.0.61 () {56 vars in 1087 bytes} [Sat Sep 24 20:33:54 2022] GET /identity/v3/services => generated 1002 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:33:54.503386 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1363bd-b020-47fc-b759-fe8b58c8e199 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:54.542641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0efaf4-d788-41f3-87fc-6f86d0e60ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:54.543284 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0efaf4-d788-41f3-87fc-6f86d0e60ac2 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:54.543679 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0efaf4-d788-41f3-87fc-6f86d0e60ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:54.543961 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0efaf4-d788-41f3-87fc-6f86d0e60ac2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:54.552863 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0efaf4-d788-41f3-87fc-6f86d0e60ac2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:54.554942 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0efaf4-d788-41f3-87fc-6f86d0e60ac2 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:54.567898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-5a0efaf4-d788-41f3-87fc-6f86d0e60ac2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 20:33:54.567898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:54.567898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:54.567898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:54.567898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:54.567898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:54.567898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:54.567898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:54.567898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:54.567898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:54.567898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:54.567898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:54.567898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:33:54.567898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:33:54.567898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:33:54.567898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:54.568946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:54.570610 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:54.570610 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:54.570610 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:33:54.570610 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:33:54.570610 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:33:54.570610 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:33:54.570610 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:33:54.570610 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:33:54.570610 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 20:33:54.570610 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:54.570610 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 353/718] 10.222.0.61 () {56 vars in 1093 bytes} [Sat Sep 24 20:33:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:33:54.575648 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc6c70-b6c5-460b-a198-57675de999e4 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:54.700262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc6c70-b6c5-460b-a198-57675de999e4 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:54.736647 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dddc1e-717f-4d2e-b60b-2dc40f233540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:54.737621 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dddc1e-717f-4d2e-b60b-2dc40f233540 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:54.738133 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dddc1e-717f-4d2e-b60b-2dc40f233540 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:54.738626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dddc1e-717f-4d2e-b60b-2dc40f233540 None admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:54.739629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dddc1e-717f-4d2e-b60b-2dc40f233540 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:54.740141 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dddc1e-717f-4d2e-b60b-2dc40f233540 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:54.742323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dddc1e-717f-4d2e-b60b-2dc40f233540 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:54.761896 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 366/719] 10.222.0.61 () {56 vars in 1133 bytes} [Sat Sep 24 20:33:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:54.768268 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0efaf4-d788-41f3-87fc-6f86d0e60ac2 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:54.812096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:54.875614 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0efaf4-d788-41f3-87fc-6f86d0e60ac2 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:54.912423 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9a52d-f6c7-41e7-8881-c1b25fd80bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:54.913039 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9a52d-f6c7-41e7-8881-c1b25fd80bdb None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:54.913323 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9a52d-f6c7-41e7-8881-c1b25fd80bdb None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:54.913668 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9a52d-f6c7-41e7-8881-c1b25fd80bdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:54.983909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9a52d-f6c7-41e7-8881-c1b25fd80bdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:54.985701 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9a52d-f6c7-41e7-8881-c1b25fd80bdb None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:55.026985 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:55.089467 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 354/720] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:33:54 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 20:33:55.095040 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dddc1e-717f-4d2e-b60b-2dc40f233540 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:55.144843 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:55.203150 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dddc1e-717f-4d2e-b60b-2dc40f233540 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:55.238585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e21dbf-d41a-452f-ac85-613be92a4153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:55.239150 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e21dbf-d41a-452f-ac85-613be92a4153 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:55.239431 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e21dbf-d41a-452f-ac85-613be92a4153 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:55.239763 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e21dbf-d41a-452f-ac85-613be92a4153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:55.254075 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e21dbf-d41a-452f-ac85-613be92a4153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:55.256730 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e21dbf-d41a-452f-ac85-613be92a4153 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:55.275751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-d7e21dbf-d41a-452f-ac85-613be92a4153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:55.275751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:55.275751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:55.275751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:55.275751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:55.275751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:55.275751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:55.275751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:55.275751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:55.275751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:55.275751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:55.275751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:55.275751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:33:55.275751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:33:55.275751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:33:55.275751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:55.276830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:33:55.277778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:33:55.277778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:33:55.277778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:55.277778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 367/721] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:55.282853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9a52d-f6c7-41e7-8881-c1b25fd80bdb None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:55.385617 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9a52d-f6c7-41e7-8881-c1b25fd80bdb None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:55.420315 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b465b69-6ee4-445a-b7bd-dcbefdc0e22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:55.420947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b465b69-6ee4-445a-b7bd-dcbefdc0e22d None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:55.421226 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b465b69-6ee4-445a-b7bd-dcbefdc0e22d None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:55.421500 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b465b69-6ee4-445a-b7bd-dcbefdc0e22d None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:55.422137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b465b69-6ee4-445a-b7bd-dcbefdc0e22d None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:55.422438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b465b69-6ee4-445a-b7bd-dcbefdc0e22d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:55.423786 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b465b69-6ee4-445a-b7bd-dcbefdc0e22d None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:55.433086 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:55.439618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 355/722] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:55.442550 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e21dbf-d41a-452f-ac85-613be92a4153 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:55.542133 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:55.549172 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e21dbf-d41a-452f-ac85-613be92a4153 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:55.595502 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d02291-2ba3-438d-a039-106491227fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:55.596136 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d02291-2ba3-438d-a039-106491227fce None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:55.596445 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d02291-2ba3-438d-a039-106491227fce None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:55.596723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d02291-2ba3-438d-a039-106491227fce None admin] PATH_INFO: `/v3/projects/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:55.604255 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d02291-2ba3-438d-a039-106491227fce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:55.605723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d02291-2ba3-438d-a039-106491227fce None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:55.616802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-a1d02291-2ba3-438d-a039-106491227fce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:55.616802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:55.616802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:55.616802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:55.616802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:55.616802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:55.616802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:55.616802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:55.616802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:55.616802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:55.616802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:55.616802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:55.616802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:33:55.616802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:33:55.616802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:55.617693 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:55.618612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:33:55.618612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:33:55.618612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:33:55.618612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:33:55.618612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:33:55.618612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:33:55.618612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:33:55.618612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:55.618612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 368/723] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:55.623872 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b465b69-6ee4-445a-b7bd-dcbefdc0e22d None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:55.733423 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b465b69-6ee4-445a-b7bd-dcbefdc0e22d None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:55.768807 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e924250-cfbf-45b1-8650-1032742270fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:55.769418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e924250-cfbf-45b1-8650-1032742270fd None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:55.769699 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e924250-cfbf-45b1-8650-1032742270fd None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:55.769975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e924250-cfbf-45b1-8650-1032742270fd None admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:55.770668 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e924250-cfbf-45b1-8650-1032742270fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:55.770975 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e924250-cfbf-45b1-8650-1032742270fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:55.772427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e924250-cfbf-45b1-8650-1032742270fd None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:55.785589 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 356/724] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:33:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:55.793884 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d02291-2ba3-438d-a039-106491227fce None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:55.905154 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d02291-2ba3-438d-a039-106491227fce None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:55.942198 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fb9a0-6cf8-47ae-8bd1-4c06df11fc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:55.943232 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fb9a0-6cf8-47ae-8bd1-4c06df11fc64 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:55.943709 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fb9a0-6cf8-47ae-8bd1-4c06df11fc64 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:55.944173 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fb9a0-6cf8-47ae-8bd1-4c06df11fc64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:55.945196 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fb9a0-6cf8-47ae-8bd1-4c06df11fc64 None admin] RBAC: Adding query filter params (role.id=9cc90aa0ccde4b75b7642101cbf45cf2, scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341, user.id=bc96ad30b91b46af92ff5b27a6b83abd) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:55.945704 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fb9a0-6cf8-47ae-8bd1-4c06df11fc64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:55.947311 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fb9a0-6cf8-47ae-8bd1-4c06df11fc64 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:55.954072 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 369/725] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:33:55 2022] GET /identity/v3/role_assignments?user.id=bc96ad30b91b46af92ff5b27a6b83abd&scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341&role.id=9cc90aa0ccde4b75b7642101cbf45cf2 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:56.168887 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59154c9-860a-4e8d-ae3b-e0e2a841f422 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:56.169175 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59154c9-860a-4e8d-ae3b-e0e2a841f422 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:56.169453 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59154c9-860a-4e8d-ae3b-e0e2a841f422 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:56.171004 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 357/726] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:56.176801 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf411d-20d6-47dc-8440-3db1aa8f8a87 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:56.177110 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf411d-20d6-47dc-8440-3db1aa8f8a87 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:56.177659 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf411d-20d6-47dc-8440-3db1aa8f8a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:56.199040 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-06cf411d-20d6-47dc-8440-3db1aa8f8a87 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:56.200705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-06cf411d-20d6-47dc-8440-3db1aa8f8a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:56.219050 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:56.272808 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 370/727] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:56 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:33:56.471322 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed313e-e78f-41b9-bb34-f867feec3d3c None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:56.471826 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed313e-e78f-41b9-bb34-f867feec3d3c None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:56.471826 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed313e-e78f-41b9-bb34-f867feec3d3c None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:56.473353 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 358/728] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:56.479084 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04b3ff-7dd4-4ff8-acc1-9efacb4bf444 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:56.479396 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04b3ff-7dd4-4ff8-acc1-9efacb4bf444 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:56.479638 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04b3ff-7dd4-4ff8-acc1-9efacb4bf444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:56.498045 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-1a04b3ff-7dd4-4ff8-acc1-9efacb4bf444 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:56.499222 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-1a04b3ff-7dd4-4ff8-acc1-9efacb4bf444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:56.572065 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 371/729] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:56 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 20:33:56.601982 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed313e-e78f-41b9-bb34-f867feec3d3c None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:56.664065 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:56.707543 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed313e-e78f-41b9-bb34-f867feec3d3c None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:56.742942 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896364e7-7e2c-4dea-9c99-8d85895fa0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:56.743887 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896364e7-7e2c-4dea-9c99-8d85895fa0da None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:56.744424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896364e7-7e2c-4dea-9c99-8d85895fa0da None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:56.744897 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896364e7-7e2c-4dea-9c99-8d85895fa0da None admin] PATH_INFO: `/v3/services/image` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:56.745737 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896364e7-7e2c-4dea-9c99-8d85895fa0da None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:56.747331 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896364e7-7e2c-4dea-9c99-8d85895fa0da None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-896364e7-7e2c-4dea-9c99-8d85895fa0da None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:56.756488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:56.757599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:56.757599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:56.757599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:56.757599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:56.757599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:56.757599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:56.757599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:33:56.757599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:33:56.757599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:33:56.757599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:33:56.757599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:56.757599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:56.757599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:56.757599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:56.757599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:56.757599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:56.758456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:56.758456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:56.758456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:56.758456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:56.758456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:56.758456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:56.758456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:56.758456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:56.758456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:56.758456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:56.758456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:33:56.758456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:56.758456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 20:33:56.758456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:56.761156 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 359/730] 10.222.0.61 () {56 vars in 1105 bytes} [Sat Sep 24 20:33:56 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:56.769434 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04b3ff-7dd4-4ff8-acc1-9efacb4bf444 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:56.854014 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:56.873498 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04b3ff-7dd4-4ff8-acc1-9efacb4bf444 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:56.912559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dba4c-dc0a-42c2-8ae2-daccfe9e9def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:56.913202 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dba4c-dc0a-42c2-8ae2-daccfe9e9def None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:56.913566 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dba4c-dc0a-42c2-8ae2-daccfe9e9def None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:56.913838 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dba4c-dc0a-42c2-8ae2-daccfe9e9def None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:56.914461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354dba4c-dc0a-42c2-8ae2-daccfe9e9def None admin] RBAC: Adding query filter params (name=image) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:56.914763 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354dba4c-dc0a-42c2-8ae2-daccfe9e9def None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:56.916387 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354dba4c-dc0a-42c2-8ae2-daccfe9e9def None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:56.921194 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 372/731] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:56.926758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896364e7-7e2c-4dea-9c99-8d85895fa0da None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:56.946166 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dba4c-dc0a-42c2-8ae2-daccfe9e9def None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:57.042618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896364e7-7e2c-4dea-9c99-8d85895fa0da None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:57.057049 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dba4c-dc0a-42c2-8ae2-daccfe9e9def None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:57.065283 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:57.077290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951396b1-380b-4b15-bfaf-5ff8a1c195aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:57.077891 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951396b1-380b-4b15-bfaf-5ff8a1c195aa None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:57.078174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951396b1-380b-4b15-bfaf-5ff8a1c195aa None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:57.078450 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951396b1-380b-4b15-bfaf-5ff8a1c195aa None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:57.079075 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951396b1-380b-4b15-bfaf-5ff8a1c195aa None admin] RBAC: Adding query filter params (type=image) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:57.079394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951396b1-380b-4b15-bfaf-5ff8a1c195aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:57.080782 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951396b1-380b-4b15-bfaf-5ff8a1c195aa None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:57.086416 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 360/732] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:33:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:57.087518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502108f-6c9c-4074-9c2c-dc0aa20c2bc7 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:57.087799 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502108f-6c9c-4074-9c2c-dc0aa20c2bc7 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:57.088073 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502108f-6c9c-4074-9c2c-dc0aa20c2bc7 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:57.089458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 361/733] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:57.093462 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502108f-6c9c-4074-9c2c-dc0aa20c2bc7 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:57.098429 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6358d-76a0-4bb6-b219-75d1d7c996d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:57.099061 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6358d-76a0-4bb6-b219-75d1d7c996d4 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:57.099342 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6358d-76a0-4bb6-b219-75d1d7c996d4 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:57.099618 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6358d-76a0-4bb6-b219-75d1d7c996d4 None admin] PATH_INFO: `/v3/services/network` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:57.100195 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6358d-76a0-4bb6-b219-75d1d7c996d4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:57.101642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6358d-76a0-4bb6-b219-75d1d7c996d4 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-cad6358d-76a0-4bb6-b219-75d1d7c996d4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:57.110631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:57.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:57.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:57.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:57.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:57.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:57.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:57.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:33:57.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:33:57.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:33:57.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:33:57.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:57.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:57.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:57.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:57.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:57.111611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:57.112849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:57.112849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:57.112849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:57.112849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:57.112849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:57.112849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:57.112849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:57.112849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:57.112849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:57.112849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:57.112849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:33:57.112849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:57.112849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 20:33:57.112849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:57.112849 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 373/734] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:33:56 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:33:57.113657 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4845f3-fa78-41a5-9d91-730dc4e72b23 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:57.113657 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4845f3-fa78-41a5-9d91-730dc4e72b23 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:57.114006 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4845f3-fa78-41a5-9d91-730dc4e72b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:57.135398 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-af4845f3-fa78-41a5-9d91-730dc4e72b23 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:57.136595 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-af4845f3-fa78-41a5-9d91-730dc4e72b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:57.140146 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:57.219806 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502108f-6c9c-4074-9c2c-dc0aa20c2bc7 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:57.220799 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 374/735] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:57 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:33:57.222106 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4845f3-fa78-41a5-9d91-730dc4e72b23 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:57.265749 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8c399-9dfc-4c1c-9142-987407c5c2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:57.266401 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8c399-9dfc-4c1c-9142-987407c5c2b6 None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:57.266684 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8c399-9dfc-4c1c-9142-987407c5c2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:57.266967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8c399-9dfc-4c1c-9142-987407c5c2b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:57.267623 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8c399-9dfc-4c1c-9142-987407c5c2b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:57.269022 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8c399-9dfc-4c1c-9142-987407c5c2b6 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:57.300456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 362/736] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Sep 24 20:33:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:33:57.364680 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4845f3-fa78-41a5-9d91-730dc4e72b23 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:57.410724 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa0fbd-de79-4a12-8c39-f3bef5a3cbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:57.411519 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa0fbd-de79-4a12-8c39-f3bef5a3cbfc None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:57.411804 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa0fbd-de79-4a12-8c39-f3bef5a3cbfc None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:57.412078 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa0fbd-de79-4a12-8c39-f3bef5a3cbfc None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:57.412814 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa0fbd-de79-4a12-8c39-f3bef5a3cbfc None admin] RBAC: Adding query filter params (name=network) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:57.413130 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa0fbd-de79-4a12-8c39-f3bef5a3cbfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:57.415105 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa0fbd-de79-4a12-8c39-f3bef5a3cbfc None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:57.417535 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:57.422026 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 375/737] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Sep 24 20:33:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:57.428326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8c399-9dfc-4c1c-9142-987407c5c2b6 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:57.481344 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:57.547648 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8c399-9dfc-4c1c-9142-987407c5c2b6 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:57.567500 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa0fbd-de79-4a12-8c39-f3bef5a3cbfc None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:57.588367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea9f93-84b9-43d2-a4f6-e2fa2102022a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:57.589142 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea9f93-84b9-43d2-a4f6-e2fa2102022a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:57.589420 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea9f93-84b9-43d2-a4f6-e2fa2102022a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:57.589692 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea9f93-84b9-43d2-a4f6-e2fa2102022a None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:57.590321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea9f93-84b9-43d2-a4f6-e2fa2102022a None admin] RBAC: Adding query filter params (type=network) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:57.590622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea9f93-84b9-43d2-a4f6-e2fa2102022a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:57.591967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea9f93-84b9-43d2-a4f6-e2fa2102022a None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:57.597225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 363/738] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Sep 24 20:33:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:57.605588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea9f93-84b9-43d2-a4f6-e2fa2102022a None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:57.684281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa0fbd-de79-4a12-8c39-f3bef5a3cbfc None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:57.724864 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d31843-44fe-4277-91fd-1e81d017a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:57.725761 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d31843-44fe-4277-91fd-1e81d017a684 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:57.726240 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d31843-44fe-4277-91fd-1e81d017a684 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:57.726679 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d31843-44fe-4277-91fd-1e81d017a684 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:57.727403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d31843-44fe-4277-91fd-1e81d017a684 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:57.728934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d31843-44fe-4277-91fd-1e81d017a684 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:57.729168 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea9f93-84b9-43d2-a4f6-e2fa2102022a None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-f4d31843-44fe-4277-91fd-1e81d017a684 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:57.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:57.739562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:57.739562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:57.739562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:57.739562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:57.739562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:57.739562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:57.739562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:33:57.739562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:33:57.739562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:33:57.739562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:33:57.739562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:57.739562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:57.739562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:57.739562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:57.739562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:57.739562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:57.740705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:57.740705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:57.740705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:57.740705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:57.740705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:57.740705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:57.740705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:57.740705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:57.740705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:57.740705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:57.740705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:33:57.740705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:57.740705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 20:33:57.740705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:33:57.742345 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:57.744020 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 376/739] 10.222.0.61 () {56 vars in 1129 bytes} [Sat Sep 24 20:33:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:33:57.749558 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d31843-44fe-4277-91fd-1e81d017a684 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:57.770674 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbac3a-ed64-4ede-8c11-812c4df912bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:57.771628 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbac3a-ed64-4ede-8c11-812c4df912bb None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:57.772098 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbac3a-ed64-4ede-8c11-812c4df912bb None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:57.773137 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbac3a-ed64-4ede-8c11-812c4df912bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:57.774252 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbac3a-ed64-4ede-8c11-812c4df912bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:57.776090 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbac3a-ed64-4ede-8c11-812c4df912bb None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:57.798698 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 364/740] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Sep 24 20:33:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:33:57.821290 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:57.867477 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d31843-44fe-4277-91fd-1e81d017a684 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:57.919783 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66db7b-00ff-4264-a83b-ac484d976373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:57.920442 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66db7b-00ff-4264-a83b-ac484d976373 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:57.920733 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66db7b-00ff-4264-a83b-ac484d976373 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:57.920999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66db7b-00ff-4264-a83b-ac484d976373 None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:57.921633 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66db7b-00ff-4264-a83b-ac484d976373 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:57.921935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66db7b-00ff-4264-a83b-ac484d976373 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:57.923310 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66db7b-00ff-4264-a83b-ac484d976373 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:57.929235 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 377/741] 10.222.0.61 () {56 vars in 1124 bytes} [Sat Sep 24 20:33:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:33:57.937526 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbac3a-ed64-4ede-8c11-812c4df912bb None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:58.053087 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbac3a-ed64-4ede-8c11-812c4df912bb None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:58.091741 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda091d-2520-453e-82dd-30659c238a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:58.092324 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda091d-2520-453e-82dd-30659c238a8a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:58.092640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda091d-2520-453e-82dd-30659c238a8a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:58.092917 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda091d-2520-453e-82dd-30659c238a8a None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:58.093547 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda091d-2520-453e-82dd-30659c238a8a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:58.093854 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda091d-2520-453e-82dd-30659c238a8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:58.095215 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda091d-2520-453e-82dd-30659c238a8a None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:58.101183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 365/742] 10.222.0.61 () {56 vars in 1124 bytes} [Sat Sep 24 20:33:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:58.106608 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66db7b-00ff-4264-a83b-ac484d976373 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:58.223797 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66db7b-00ff-4264-a83b-ac484d976373 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:58.249169 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:58.260971 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482483c-178f-4951-a997-d8fda91a981f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:58.261579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482483c-178f-4951-a997-d8fda91a981f None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:58.261865 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482483c-178f-4951-a997-d8fda91a981f None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:58.262140 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482483c-178f-4951-a997-d8fda91a981f None admin] PATH_INFO: `/v3/endpoints` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:58.262796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482483c-178f-4951-a997-d8fda91a981f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:58.264158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482483c-178f-4951-a997-d8fda91a981f None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:58.292376 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 378/743] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Sep 24 20:33:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:33:58.574484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be311c33-18a6-4b9c-865b-c86c81e1649d None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:58.575040 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be311c33-18a6-4b9c-865b-c86c81e1649d None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:58.575040 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be311c33-18a6-4b9c-865b-c86c81e1649d None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:58.576485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 366/744] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:58.581557 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16194a-b2b3-4beb-86dc-77e5c54f5ba0 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:58.581945 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16194a-b2b3-4beb-86dc-77e5c54f5ba0 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:58.582122 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16194a-b2b3-4beb-86dc-77e5c54f5ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:58.601562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-aa16194a-b2b3-4beb-86dc-77e5c54f5ba0 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:58.602732 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-aa16194a-b2b3-4beb-86dc-77e5c54f5ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:58.676487 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 379/745] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:58 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:33:58.999261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be311c33-18a6-4b9c-865b-c86c81e1649d None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:59.028858 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:59.104718 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be311c33-18a6-4b9c-865b-c86c81e1649d None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:59.141575 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2272bc2-ce4e-4413-90df-1e0cc92eff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:59.141575 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2272bc2-ce4e-4413-90df-1e0cc92eff8c None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:59.141575 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2272bc2-ce4e-4413-90df-1e0cc92eff8c None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:59.141575 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2272bc2-ce4e-4413-90df-1e0cc92eff8c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:59.141987 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2272bc2-ce4e-4413-90df-1e0cc92eff8c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:59.141987 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2272bc2-ce4e-4413-90df-1e0cc92eff8c None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:59.151326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-f2272bc2-ce4e-4413-90df-1e0cc92eff8c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 20:33:59.151326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:59.151326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:33:59.151326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:33:59.151326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:33:59.151326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:33:59.151326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:33:59.151326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:59.151326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 20:33:59.151326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:59.151326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:33:59.151326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:59.151326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:33:59.151326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:33:59.151326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:33:59.151326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:33:59.152242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:33:59.153497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:33:59.153497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:33:59.153497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:33:59.153497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:33:59.153497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:33:59.153497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:33:59.153497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:33:59.153497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:33:59.153497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:33:59.153497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:33:59.153497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:33:59.153497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:33:59.153497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 20:33:59.153497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:33:59.158671 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 367/746] 10.222.0.61 () {56 vars in 1132 bytes} [Sat Sep 24 20:33:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:33:59.164842 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16194a-b2b3-4beb-86dc-77e5c54f5ba0 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:59.280510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16194a-b2b3-4beb-86dc-77e5c54f5ba0 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:59.288150 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:59.317077 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54520697-aa03-46ac-810f-2cda9f74916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:59.317684 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54520697-aa03-46ac-810f-2cda9f74916b None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:59.317964 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54520697-aa03-46ac-810f-2cda9f74916b None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:59.318244 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54520697-aa03-46ac-810f-2cda9f74916b None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:59.318870 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54520697-aa03-46ac-810f-2cda9f74916b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:59.319173 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54520697-aa03-46ac-810f-2cda9f74916b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:59.320684 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54520697-aa03-46ac-810f-2cda9f74916b None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:59.329872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 380/747] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Sep 24 20:33:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:59.331380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2272bc2-ce4e-4413-90df-1e0cc92eff8c None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:33:59.426452 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:33:59.438209 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2272bc2-ce4e-4413-90df-1e0cc92eff8c None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:33:59.475044 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5674d5-b96c-458b-b303-7aba837961ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:33:59.476169 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5674d5-b96c-458b-b303-7aba837961ec None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:59.476484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5674d5-b96c-458b-b303-7aba837961ec None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:59.476756 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5674d5-b96c-458b-b303-7aba837961ec None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:59.477384 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5674d5-b96c-458b-b303-7aba837961ec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:33:59.477682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5674d5-b96c-458b-b303-7aba837961ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:33:59.479029 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5674d5-b96c-458b-b303-7aba837961ec None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:33:59.483672 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 368/748] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Sep 24 20:33:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:33:59.871696 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8d2a0-d2f1-4588-a4e8-149f99d78d5d None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:59.872248 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8d2a0-d2f1-4588-a4e8-149f99d78d5d None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:59.872248 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8d2a0-d2f1-4588-a4e8-149f99d78d5d None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:59.873612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 381/749] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:33:59.878638 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dddea-412c-4f8b-9679-7083641d41ab None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:33:59.879031 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dddea-412c-4f8b-9679-7083641d41ab None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:33:59.879202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dddea-412c-4f8b-9679-7083641d41ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:33:59.897202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-1e7dddea-412c-4f8b-9679-7083641d41ab None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:33:59.898920 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-1e7dddea-412c-4f8b-9679-7083641d41ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:33:59.966066 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 369/750] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:33:59 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:34:00.291294 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8d2a0-d2f1-4588-a4e8-149f99d78d5d None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:00.399763 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8d2a0-d2f1-4588-a4e8-149f99d78d5d None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:00.434543 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81de49-8f21-4bb9-8f2f-07880681b27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:00.435069 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81de49-8f21-4bb9-8f2f-07880681b27a None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:00.435645 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81de49-8f21-4bb9-8f2f-07880681b27a None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:00.435922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81de49-8f21-4bb9-8f2f-07880681b27a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:00.474005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:00.503510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81de49-8f21-4bb9-8f2f-07880681b27a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:00.504975 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81de49-8f21-4bb9-8f2f-07880681b27a None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:00.606828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 382/751] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:34:00 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 20:34:00.612376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dddea-412c-4f8b-9679-7083641d41ab None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:00.696443 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:00.713754 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dddea-412c-4f8b-9679-7083641d41ab None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:00.727582 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c9709-d563-4e76-9be5-4f767f02a0ed None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:00.727884 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c9709-d563-4e76-9be5-4f767f02a0ed None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:00.728293 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c9709-d563-4e76-9be5-4f767f02a0ed None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:00.730450 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 383/752] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:34:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:34:00.735407 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528418b8-b5b5-4d3b-a10c-805aca13e2c9 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:00.735692 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528418b8-b5b5-4d3b-a10c-805aca13e2c9 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:00.735967 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528418b8-b5b5-4d3b-a10c-805aca13e2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:00.750480 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07f9fe-4085-430b-90d0-0139cc9be025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:00.751113 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07f9fe-4085-430b-90d0-0139cc9be025 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:00.751416 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07f9fe-4085-430b-90d0-0139cc9be025 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:00.751694 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07f9fe-4085-430b-90d0-0139cc9be025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:00.753821 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-528418b8-b5b5-4d3b-a10c-805aca13e2c9 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:34:00.755000 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-528418b8-b5b5-4d3b-a10c-805aca13e2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:34:00.763784 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07f9fe-4085-430b-90d0-0139cc9be025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:00.765632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07f9fe-4085-430b-90d0-0139cc9be025 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:00.781528 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-2b07f9fe-4085-430b-90d0-0139cc9be025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:34:00.781528 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:00.781528 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:34:00.781528 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:34:00.781528 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:34:00.781528 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:34:00.781528 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:34:00.781528 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:34:00.781528 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:34:00.781528 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:34:00.781528 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:34:00.781528 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:34:00.781528 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:34:00.781528 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:34:00.781528 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:34:00.781528 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:34:00.782588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:34:00.783686 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:34:00.783686 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:34:00.783686 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:00.783686 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 370/753] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:34:00.788453 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07f9fe-4085-430b-90d0-0139cc9be025 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:00.832841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:00.839321 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 384/754] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:34:00 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 20:34:00.899193 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07f9fe-4085-430b-90d0-0139cc9be025 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:00.936231 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99495281-2e22-4b83-a531-2adf7c740e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:00.936933 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99495281-2e22-4b83-a531-2adf7c740e51 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:00.937217 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99495281-2e22-4b83-a531-2adf7c740e51 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:00.937491 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99495281-2e22-4b83-a531-2adf7c740e51 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:00.938150 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99495281-2e22-4b83-a531-2adf7c740e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:00.938456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99495281-2e22-4b83-a531-2adf7c740e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:00.939804 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99495281-2e22-4b83-a531-2adf7c740e51 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:00.947616 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:00.961149 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 371/755] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:34:01.164758 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528418b8-b5b5-4d3b-a10c-805aca13e2c9 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:01.270405 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528418b8-b5b5-4d3b-a10c-805aca13e2c9 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:01.306474 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf2252-94e5-4475-8fea-e881f9d9a27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:01.307103 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf2252-94e5-4475-8fea-e881f9d9a27d None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:01.307378 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf2252-94e5-4475-8fea-e881f9d9a27d None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:01.307648 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf2252-94e5-4475-8fea-e881f9d9a27d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:01.308226 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf2252-94e5-4475-8fea-e881f9d9a27d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:01.309622 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf2252-94e5-4475-8fea-e881f9d9a27d None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-8dbf2252-94e5-4475-8fea-e881f9d9a27d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:34:01.318367 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:34:01.320204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:34:01.320204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:34:01.320204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:34:01.320204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:34:01.320204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:34:01.320204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:34:01.320204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:34:01.320204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:34:01.320204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:34:01.320204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:34:01.320204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:34:01.320204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:34:01.320204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:34:01.320204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:34:01.320204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:34:01.320204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:34:01.321301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:34:01.321301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:34:01.321301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:34:01.321301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:34:01.321301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:34:01.321301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:34:01.321301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:34:01.321301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:34:01.321301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:34:01.321301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:34:01.321301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:34:01.321301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:34:01.321301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 20:34:01.321301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:01.321301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 385/756] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:34:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:34:01.327255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99495281-2e22-4b83-a531-2adf7c740e51 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:01.425288 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99495281-2e22-4b83-a531-2adf7c740e51 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:01.459035 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b270f-e225-47f0-881f-5c8314d115ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:01.459634 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b270f-e225-47f0-881f-5c8314d115ce None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:01.460030 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b270f-e225-47f0-881f-5c8314d115ce None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:01.460310 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b270f-e225-47f0-881f-5c8314d115ce None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:01.460959 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b270f-e225-47f0-881f-5c8314d115ce None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:01.461258 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b270f-e225-47f0-881f-5c8314d115ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:01.462629 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b270f-e225-47f0-881f-5c8314d115ce None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:01.467502 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 372/757] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:34:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:34:01.473438 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf2252-94e5-4475-8fea-e881f9d9a27d None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:01.539242 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:01.578484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf2252-94e5-4475-8fea-e881f9d9a27d None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:01.611731 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0c85b-55fc-42b6-9a2e-c43d5dcb26e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:01.612354 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0c85b-55fc-42b6-9a2e-c43d5dcb26e6 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:01.612641 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0c85b-55fc-42b6-9a2e-c43d5dcb26e6 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:01.612915 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0c85b-55fc-42b6-9a2e-c43d5dcb26e6 None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:01.613538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0c85b-55fc-42b6-9a2e-c43d5dcb26e6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:01.613839 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0c85b-55fc-42b6-9a2e-c43d5dcb26e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:01.615199 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0c85b-55fc-42b6-9a2e-c43d5dcb26e6 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:01.619618 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 386/758] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:34:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:34:01.911251 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d6854-5678-4b9c-9799-410492bb8e3f None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:01.911794 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d6854-5678-4b9c-9799-410492bb8e3f None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:01.911886 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d6854-5678-4b9c-9799-410492bb8e3f None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:01.913291 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 373/759] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:34:01.918843 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8e898-7910-4a78-9d6c-9b1dd9fadc10 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:01.919134 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8e898-7910-4a78-9d6c-9b1dd9fadc10 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:01.919410 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8e898-7910-4a78-9d6c-9b1dd9fadc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:01.937294 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-5bc8e898-7910-4a78-9d6c-9b1dd9fadc10 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:34:01.938467 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-5bc8e898-7910-4a78-9d6c-9b1dd9fadc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:34:02.003095 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 387/760] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:34:01 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:34:02.322491 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d6854-5678-4b9c-9799-410492bb8e3f None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:02.385863 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:02.424810 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d6854-5678-4b9c-9799-410492bb8e3f None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:02.457400 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a1218-d663-49ec-9e90-bc6e1a5a102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:02.457994 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a1218-d663-49ec-9e90-bc6e1a5a102a None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:02.458271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a1218-d663-49ec-9e90-bc6e1a5a102a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:02.458542 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a1218-d663-49ec-9e90-bc6e1a5a102a None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:02.459190 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a1218-d663-49ec-9e90-bc6e1a5a102a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:02.461149 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a1218-d663-49ec-9e90-bc6e1a5a102a None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:02.476424 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 374/761] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Sep 24 20:34:02 2022] POST /identity/v3/services => generated 269 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:34:03.997544 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57041fc1-0ea1-49b0-b739-da61a19d9cee None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:03.998107 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57041fc1-0ea1-49b0-b739-da61a19d9cee None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:03.998107 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57041fc1-0ea1-49b0-b739-da61a19d9cee None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:03.999412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 388/762] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:34:04.004567 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab810494-594c-4b4f-9b3a-26ba6a162071 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:04.004968 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab810494-594c-4b4f-9b3a-26ba6a162071 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:04.005119 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab810494-594c-4b4f-9b3a-26ba6a162071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:04.023996 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-ab810494-594c-4b4f-9b3a-26ba6a162071 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:34:04.025195 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-ab810494-594c-4b4f-9b3a-26ba6a162071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:34:04.095239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 375/763] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:34:04 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:34:04.415293 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57041fc1-0ea1-49b0-b739-da61a19d9cee None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:04.482951 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:04.524293 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57041fc1-0ea1-49b0-b739-da61a19d9cee None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:04.557178 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25aa4da-f35a-4cb2-b1eb-b401f7daf8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:04.557773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aa4da-f35a-4cb2-b1eb-b401f7daf8f1 None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:04.558055 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aa4da-f35a-4cb2-b1eb-b401f7daf8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:04.558325 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25aa4da-f35a-4cb2-b1eb-b401f7daf8f1 None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:04.558962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25aa4da-f35a-4cb2-b1eb-b401f7daf8f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:04.560308 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25aa4da-f35a-4cb2-b1eb-b401f7daf8f1 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:04.575502 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 389/764] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Sep 24 20:34:04 2022] POST /identity/v3/services => generated 251 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:34:04.886400 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6b117-4e0f-4b12-be8c-9221fb2ad002 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:04.886598 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6b117-4e0f-4b12-be8c-9221fb2ad002 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:04.886861 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6b117-4e0f-4b12-be8c-9221fb2ad002 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:04.888189 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 376/765] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:34:04.893590 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e8994-842d-442a-a86d-a3a4d7747975 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:04.893875 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e8994-842d-442a-a86d-a3a4d7747975 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:04.894147 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e8994-842d-442a-a86d-a3a4d7747975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:04.912942 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-e58e8994-842d-442a-a86d-a3a4d7747975 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:34:04.914682 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-e58e8994-842d-442a-a86d-a3a4d7747975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:34:04.984422 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 390/766] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:34:04 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:34:05.308810 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6b117-4e0f-4b12-be8c-9221fb2ad002 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:05.359490 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:05.410789 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6b117-4e0f-4b12-be8c-9221fb2ad002 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:05.443166 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c4e29-6c29-425d-92b6-2a85a64b7b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:05.443726 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c4e29-6c29-425d-92b6-2a85a64b7b44 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:05.444009 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c4e29-6c29-425d-92b6-2a85a64b7b44 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:05.444814 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c4e29-6c29-425d-92b6-2a85a64b7b44 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:05.445392 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c4e29-6c29-425d-92b6-2a85a64b7b44 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:05.446746 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c4e29-6c29-425d-92b6-2a85a64b7b44 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:05.455337 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-458c4e29-6c29-425d-92b6-2a85a64b7b44 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 20:34:05.455337 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:05.455337 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:34:05.455337 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:34:05.455337 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:34:05.455337 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:34:05.455337 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:34:05.455337 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:34:05.455337 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 20:34:05.455337 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:05.455337 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:34:05.455337 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:05.455337 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:05.455337 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:34:05.455337 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:34:05.455337 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:34:05.456479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:34:05.457374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:34:05.457374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:34:05.457374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:34:05.457374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:34:05.457374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:34:05.457374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:34:05.457374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:34:05.457374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:34:05.457374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:34:05.457374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:34:05.457374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:34:05.457374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:34:05.457374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 20:34:05.457374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:05.457374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 377/767] 10.222.0.61 () {56 vars in 1132 bytes} [Sat Sep 24 20:34:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:34:05.463053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e8994-842d-442a-a86d-a3a4d7747975 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:05.506185 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:05.563345 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e8994-842d-442a-a86d-a3a4d7747975 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:05.595782 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859dbc0-bda5-424c-af51-95575377e32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:05.596415 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859dbc0-bda5-424c-af51-95575377e32e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:05.596697 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859dbc0-bda5-424c-af51-95575377e32e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:05.596970 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859dbc0-bda5-424c-af51-95575377e32e None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:05.597592 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859dbc0-bda5-424c-af51-95575377e32e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:05.597894 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859dbc0-bda5-424c-af51-95575377e32e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:05.599256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8859dbc0-bda5-424c-af51-95575377e32e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:05.603770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 391/768] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Sep 24 20:34:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:34:05.609563 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c4e29-6c29-425d-92b6-2a85a64b7b44 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:05.710479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c4e29-6c29-425d-92b6-2a85a64b7b44 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:05.722612 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:05.743640 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e2a02-28eb-4262-bbaa-c5c3157202a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:05.744238 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e2a02-28eb-4262-bbaa-c5c3157202a8 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:05.744541 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e2a02-28eb-4262-bbaa-c5c3157202a8 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:05.744810 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e2a02-28eb-4262-bbaa-c5c3157202a8 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:05.745426 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e2a02-28eb-4262-bbaa-c5c3157202a8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:05.745727 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e2a02-28eb-4262-bbaa-c5c3157202a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:05.747061 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e2a02-28eb-4262-bbaa-c5c3157202a8 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:05.751651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 378/769] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Sep 24 20:34:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:34:05.758118 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859dbc0-bda5-424c-af51-95575377e32e None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:05.856864 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859dbc0-bda5-424c-af51-95575377e32e None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:05.865986 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:05.890702 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52126be2-46e0-4110-b492-01cf441ca5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:05.891306 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52126be2-46e0-4110-b492-01cf441ca5c6 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:05.891586 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52126be2-46e0-4110-b492-01cf441ca5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:05.891862 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52126be2-46e0-4110-b492-01cf441ca5c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:05.892589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52126be2-46e0-4110-b492-01cf441ca5c6 None admin] RBAC: Adding query filter params (interface=public, service_id=effc5717d1594c13b5fd56c1ff798009, region_id=RegionOne) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:05.892898 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52126be2-46e0-4110-b492-01cf441ca5c6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:05.894252 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52126be2-46e0-4110-b492-01cf441ca5c6 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:05.899292 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 392/770] 10.222.0.61 () {56 vars in 1251 bytes} [Sat Sep 24 20:34:05 2022] GET /identity/v3/endpoints?service_id=effc5717d1594c13b5fd56c1ff798009&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:34:05.904916 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e2a02-28eb-4262-bbaa-c5c3157202a8 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:06.003368 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e2a02-28eb-4262-bbaa-c5c3157202a8 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:06.036885 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2225a21-0b35-44fe-a477-8ed49d3b1ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:06.037482 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2225a21-0b35-44fe-a477-8ed49d3b1ad8 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:06.037760 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2225a21-0b35-44fe-a477-8ed49d3b1ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:06.038034 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2225a21-0b35-44fe-a477-8ed49d3b1ad8 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:06.038624 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2225a21-0b35-44fe-a477-8ed49d3b1ad8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:06.039958 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2225a21-0b35-44fe-a477-8ed49d3b1ad8 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:06.045954 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 379/771] 10.222.0.61 () {56 vars in 1087 bytes} [Sat Sep 24 20:34:05 2022] GET /identity/v3/services => generated 1498 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:34:06.992247 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcdf3e-b988-4e66-9813-1d9a41ecdca4 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:06.992808 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcdf3e-b988-4e66-9813-1d9a41ecdca4 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:06.992952 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcdf3e-b988-4e66-9813-1d9a41ecdca4 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:06.994272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 393/772] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:34:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:34:06.999550 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327490b5-5365-4b74-ba28-80007a5cb8c9 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:06.999962 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327490b5-5365-4b74-ba28-80007a5cb8c9 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:07.000233 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327490b5-5365-4b74-ba28-80007a5cb8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:07.018261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-327490b5-5365-4b74-ba28-80007a5cb8c9 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:34:07.019442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-327490b5-5365-4b74-ba28-80007a5cb8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:34:07.053675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:07.086728 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 380/773] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:34:06 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:34:07.416361 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcdf3e-b988-4e66-9813-1d9a41ecdca4 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:07.516898 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcdf3e-b988-4e66-9813-1d9a41ecdca4 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:07.551508 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcd0a7-77fc-4f76-873a-3c4e0a5f823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:07.552128 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcd0a7-77fc-4f76-873a-3c4e0a5f823a None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:07.552442 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcd0a7-77fc-4f76-873a-3c4e0a5f823a None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:07.552718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcd0a7-77fc-4f76-873a-3c4e0a5f823a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:07.553294 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcd0a7-77fc-4f76-873a-3c4e0a5f823a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:07.554667 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcd0a7-77fc-4f76-873a-3c4e0a5f823a None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-6adcd0a7-77fc-4f76-873a-3c4e0a5f823a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:34:07.563177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:34:07.564359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:34:07.564359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:34:07.564359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:34:07.564359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:34:07.564359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:34:07.564359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:34:07.564359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:34:07.564359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:34:07.564359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:34:07.564359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:34:07.564359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:34:07.564359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:34:07.564359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:34:07.564359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:34:07.564359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:34:07.564359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:34:07.565262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:34:07.565262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:34:07.565262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:34:07.565262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:34:07.565262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:34:07.565262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:34:07.565262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:34:07.565262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:34:07.565262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:34:07.565262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:34:07.565262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:34:07.565262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:34:07.565262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 20:34:07.565262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:07.565262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 394/774] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:34:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:34:07.570797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327490b5-5365-4b74-ba28-80007a5cb8c9 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:07.665804 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327490b5-5365-4b74-ba28-80007a5cb8c9 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:07.698648 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2a196-8bd6-4f06-83c8-08b84969746b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:07.699183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2a196-8bd6-4f06-83c8-08b84969746b None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:07.699464 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2a196-8bd6-4f06-83c8-08b84969746b None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:07.699738 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2a196-8bd6-4f06-83c8-08b84969746b None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:07.700385 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2a196-8bd6-4f06-83c8-08b84969746b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:07.700694 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2a196-8bd6-4f06-83c8-08b84969746b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:07.702043 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2a196-8bd6-4f06-83c8-08b84969746b None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:07.706588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 381/775] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:34:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:34:07.712841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcd0a7-77fc-4f76-873a-3c4e0a5f823a None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:07.747425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:07.811264 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcd0a7-77fc-4f76-873a-3c4e0a5f823a None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:07.844488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c51e8-d3ea-4ed4-9515-d684b8792fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:07.845093 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c51e8-d3ea-4ed4-9515-d684b8792fec None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:07.845377 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c51e8-d3ea-4ed4-9515-d684b8792fec None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:07.845651 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c51e8-d3ea-4ed4-9515-d684b8792fec None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:07.846272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c51e8-d3ea-4ed4-9515-d684b8792fec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:07.846575 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c51e8-d3ea-4ed4-9515-d684b8792fec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:07.847940 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c51e8-d3ea-4ed4-9515-d684b8792fec None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:07.852773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 395/776] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:34:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:34:07.858676 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2a196-8bd6-4f06-83c8-08b84969746b None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:07.892103 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:07.958761 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2a196-8bd6-4f06-83c8-08b84969746b None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:07.991745 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd6e35-7072-495f-9e1e-1b12ecff8ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:07.992366 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd6e35-7072-495f-9e1e-1b12ecff8ac1 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:07.992644 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd6e35-7072-495f-9e1e-1b12ecff8ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:07.992914 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd6e35-7072-495f-9e1e-1b12ecff8ac1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:07.993593 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd6e35-7072-495f-9e1e-1b12ecff8ac1 None admin] RBAC: Adding query filter params (interface=public, service_id=4c57f0c0fe2c407896c47ab1fb57ed18, region_id=RegionOne) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:07.993898 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd6e35-7072-495f-9e1e-1b12ecff8ac1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:07.995233 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd6e35-7072-495f-9e1e-1b12ecff8ac1 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:08.000085 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 382/777] 10.222.0.61 () {56 vars in 1251 bytes} [Sat Sep 24 20:34:07 2022] GET /identity/v3/endpoints?service_id=4c57f0c0fe2c407896c47ab1fb57ed18&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:34:08.005820 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c51e8-d3ea-4ed4-9515-d684b8792fec None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:08.106867 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:08.110108 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c51e8-d3ea-4ed4-9515-d684b8792fec None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:08.145082 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245a05a-e085-4f2c-9c47-d4523c50ba00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:08.145683 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245a05a-e085-4f2c-9c47-d4523c50ba00 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:08.145963 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245a05a-e085-4f2c-9c47-d4523c50ba00 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:08.146236 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245a05a-e085-4f2c-9c47-d4523c50ba00 None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:08.146836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245a05a-e085-4f2c-9c47-d4523c50ba00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:08.148226 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245a05a-e085-4f2c-9c47-d4523c50ba00 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:08.154256 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 396/778] 10.222.0.61 () {56 vars in 1087 bytes} [Sat Sep 24 20:34:08 2022] GET /identity/v3/services => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:34:08.465127 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c9dd3-fd34-454b-99ab-1e1b94850d57 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:08.465411 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c9dd3-fd34-454b-99ab-1e1b94850d57 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:08.465688 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c9dd3-fd34-454b-99ab-1e1b94850d57 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:08.467053 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 383/779] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:34:08.472453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc14c48-c7ff-4e1b-bfe6-c94c5975d793 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:08.472806 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc14c48-c7ff-4e1b-bfe6-c94c5975d793 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:08.473148 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc14c48-c7ff-4e1b-bfe6-c94c5975d793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:08.492059 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-ddc14c48-c7ff-4e1b-bfe6-c94c5975d793 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:34:08.493247 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-ddc14c48-c7ff-4e1b-bfe6-c94c5975d793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:34:08.557595 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 397/780] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:34:08 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:34:08.877847 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c9dd3-fd34-454b-99ab-1e1b94850d57 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:08.977095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:08.982230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c9dd3-fd34-454b-99ab-1e1b94850d57 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:09.015313 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a1af0-dcb5-40fb-853f-7157e1d66256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:09.015934 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a1af0-dcb5-40fb-853f-7157e1d66256 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:09.016213 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a1af0-dcb5-40fb-853f-7157e1d66256 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:09.016521 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a1af0-dcb5-40fb-853f-7157e1d66256 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:09.017098 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a1af0-dcb5-40fb-853f-7157e1d66256 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:09.018449 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a1af0-dcb5-40fb-853f-7157e1d66256 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:09.027071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-1c7a1af0-dcb5-40fb-853f-7157e1d66256 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 20:34:09.027071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:09.027071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:34:09.027071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:34:09.027071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:34:09.027071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:34:09.027071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:34:09.027071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:34:09.027071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 20:34:09.027071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:09.027071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:34:09.027071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:09.027071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:09.027071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:34:09.027071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:34:09.027071 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:34:09.028147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:34:09.029144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:34:09.029144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:34:09.029144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:34:09.029144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:34:09.029144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:34:09.029144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:34:09.029144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:34:09.029144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:34:09.029144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:34:09.029144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:34:09.029144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:34:09.029144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:34:09.029144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 20:34:09.029144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:09.029144 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 384/781] 10.222.0.61 () {56 vars in 1132 bytes} [Sat Sep 24 20:34:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:34:09.034020 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc14c48-c7ff-4e1b-bfe6-c94c5975d793 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:09.123030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:09.130185 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc14c48-c7ff-4e1b-bfe6-c94c5975d793 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:09.172486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e3c7b-6ae6-42fe-8f78-0daaadad5401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:09.173129 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e3c7b-6ae6-42fe-8f78-0daaadad5401 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:09.173410 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e3c7b-6ae6-42fe-8f78-0daaadad5401 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:09.173684 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e3c7b-6ae6-42fe-8f78-0daaadad5401 None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:09.174312 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e3c7b-6ae6-42fe-8f78-0daaadad5401 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:09.174619 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e3c7b-6ae6-42fe-8f78-0daaadad5401 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:09.175978 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e3c7b-6ae6-42fe-8f78-0daaadad5401 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:09.180583 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 398/782] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Sep 24 20:34:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:34:09.186633 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a1af0-dcb5-40fb-853f-7157e1d66256 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:09.288950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a1af0-dcb5-40fb-853f-7157e1d66256 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:09.322163 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb5eba-2476-4c46-b149-b75e9f2b81e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:09.322777 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb5eba-2476-4c46-b149-b75e9f2b81e3 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:09.323046 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb5eba-2476-4c46-b149-b75e9f2b81e3 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:09.323321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb5eba-2476-4c46-b149-b75e9f2b81e3 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:09.323944 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb5eba-2476-4c46-b149-b75e9f2b81e3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:09.324246 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb5eba-2476-4c46-b149-b75e9f2b81e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:09.325636 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb5eba-2476-4c46-b149-b75e9f2b81e3 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:09.330304 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 385/783] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Sep 24 20:34:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:34:09.336605 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e3c7b-6ae6-42fe-8f78-0daaadad5401 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:09.434605 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e3c7b-6ae6-42fe-8f78-0daaadad5401 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:09.468744 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f77bc-9df9-4e1c-b353-f0bafcd85443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:09.469353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f77bc-9df9-4e1c-b353-f0bafcd85443 None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:09.469636 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f77bc-9df9-4e1c-b353-f0bafcd85443 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:09.469913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f77bc-9df9-4e1c-b353-f0bafcd85443 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:09.470570 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f77bc-9df9-4e1c-b353-f0bafcd85443 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:09.471929 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f77bc-9df9-4e1c-b353-f0bafcd85443 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:09.491831 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 399/784] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Sep 24 20:34:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:34:10.565145 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9352fd9-9857-4204-8941-e2bc94cd6111 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:10.565659 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9352fd9-9857-4204-8941-e2bc94cd6111 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:10.565659 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9352fd9-9857-4204-8941-e2bc94cd6111 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:10.566937 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 386/785] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:34:10.573045 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15f6ab-aba8-4c9d-a020-af6eab9043c5 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:10.573474 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15f6ab-aba8-4c9d-a020-af6eab9043c5 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:10.573636 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15f6ab-aba8-4c9d-a020-af6eab9043c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:10.591448 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-be15f6ab-aba8-4c9d-a020-af6eab9043c5 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:34:10.592660 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-be15f6ab-aba8-4c9d-a020-af6eab9043c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:34:10.602647 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:10.666888 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 400/786] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:34:10 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:34:11.001789 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9352fd9-9857-4204-8941-e2bc94cd6111 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:11.032380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:11.106077 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9352fd9-9857-4204-8941-e2bc94cd6111 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:11.137779 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b19a12-6f67-4f4c-89d3-6ceb06bf9192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:11.138387 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b19a12-6f67-4f4c-89d3-6ceb06bf9192 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:11.138660 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b19a12-6f67-4f4c-89d3-6ceb06bf9192 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:11.138928 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b19a12-6f67-4f4c-89d3-6ceb06bf9192 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:11.139490 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b19a12-6f67-4f4c-89d3-6ceb06bf9192 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:11.140867 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b19a12-6f67-4f4c-89d3-6ceb06bf9192 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-22b19a12-6f67-4f4c-89d3-6ceb06bf9192 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:34:11.149967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:34:11.150999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:34:11.150999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:34:11.150999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:34:11.150999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:34:11.150999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:34:11.150999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:34:11.150999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:34:11.150999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:34:11.150999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:34:11.150999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:34:11.150999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:34:11.150999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:34:11.150999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:34:11.150999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:34:11.150999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:34:11.150999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:34:11.152214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:34:11.152214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:34:11.152214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:34:11.152214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:34:11.152214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:34:11.152214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:34:11.152214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:34:11.152214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:34:11.152214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:34:11.152214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:34:11.152214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:34:11.152214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:34:11.152214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 20:34:11.152214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:11.152214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 387/787] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:34:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:34:11.159313 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15f6ab-aba8-4c9d-a020-af6eab9043c5 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:11.262205 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15f6ab-aba8-4c9d-a020-af6eab9043c5 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:11.295612 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a2979-a671-430d-a1ee-6a50f74345ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:11.296245 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a2979-a671-430d-a1ee-6a50f74345ea None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:11.296551 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a2979-a671-430d-a1ee-6a50f74345ea None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:11.296824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a2979-a671-430d-a1ee-6a50f74345ea None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:11.297449 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a2979-a671-430d-a1ee-6a50f74345ea None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:11.297749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a2979-a671-430d-a1ee-6a50f74345ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:11.299137 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a2979-a671-430d-a1ee-6a50f74345ea None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:11.303828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 401/788] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:34:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:34:11.309478 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b19a12-6f67-4f4c-89d3-6ceb06bf9192 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:11.402242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:11.413037 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b19a12-6f67-4f4c-89d3-6ceb06bf9192 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:11.446840 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3cac8-2d22-4d30-9756-0dca2172f074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:11.447434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3cac8-2d22-4d30-9756-0dca2172f074 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:11.447709 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3cac8-2d22-4d30-9756-0dca2172f074 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:11.447974 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3cac8-2d22-4d30-9756-0dca2172f074 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:11.448623 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3cac8-2d22-4d30-9756-0dca2172f074 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:11.448924 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3cac8-2d22-4d30-9756-0dca2172f074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:11.450262 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3cac8-2d22-4d30-9756-0dca2172f074 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:11.454933 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 388/789] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Sep 24 20:34:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:34:11.461321 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a2979-a671-430d-a1ee-6a50f74345ea None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:11.465174 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:11.563687 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a2979-a671-430d-a1ee-6a50f74345ea None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:11.596946 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898715a6-6882-4611-8fdf-8f5e1a9fde00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:11.597603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898715a6-6882-4611-8fdf-8f5e1a9fde00 None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:11.597809 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898715a6-6882-4611-8fdf-8f5e1a9fde00 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:11.598080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898715a6-6882-4611-8fdf-8f5e1a9fde00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:11.598746 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898715a6-6882-4611-8fdf-8f5e1a9fde00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:11.600177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898715a6-6882-4611-8fdf-8f5e1a9fde00 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:11.620219 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 402/790] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Sep 24 20:34:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:34:11.929590 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7d488-3484-40d8-830d-7dbace74836f None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:11.930112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7d488-3484-40d8-830d-7dbace74836f None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:11.930112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7d488-3484-40d8-830d-7dbace74836f None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:11.931432 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 389/791] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:34:11.936788 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41e3e7-6c38-4d21-9e09-fe73810b6c41 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:11.937137 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41e3e7-6c38-4d21-9e09-fe73810b6c41 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:11.937496 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41e3e7-6c38-4d21-9e09-fe73810b6c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:11.955283 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-de41e3e7-6c38-4d21-9e09-fe73810b6c41 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:34:11.956480 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-de41e3e7-6c38-4d21-9e09-fe73810b6c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:34:12.011546 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:12.029004 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 403/792] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:34:11 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:34:12.349709 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7d488-3484-40d8-830d-7dbace74836f None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:12.449387 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7d488-3484-40d8-830d-7dbace74836f None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:12.485370 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cc37a-c8e8-468d-acea-eed1f73c03f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:12.485997 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cc37a-c8e8-468d-acea-eed1f73c03f2 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:12.486276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cc37a-c8e8-468d-acea-eed1f73c03f2 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:12.486547 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cc37a-c8e8-468d-acea-eed1f73c03f2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:12.487119 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cc37a-c8e8-468d-acea-eed1f73c03f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:12.488514 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cc37a-c8e8-468d-acea-eed1f73c03f2 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-218cc37a-c8e8-468d-acea-eed1f73c03f2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:34:12.497358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:34:12.498455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:34:12.498455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:34:12.498455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:34:12.498455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:34:12.498455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:34:12.498455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:34:12.498455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:34:12.498455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:34:12.498455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:34:12.498455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:34:12.498455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:34:12.498455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:34:12.498455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:34:12.498455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:34:12.498455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:34:12.498455 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:34:12.499834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:34:12.499834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:34:12.499834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:34:12.499834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:34:12.499834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:34:12.499834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:34:12.499834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:34:12.499834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:34:12.499834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:34:12.499834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:34:12.499834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:34:12.499834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:34:12.499834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 20:34:12.499834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:12.499834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 390/793] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:34:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:34:12.504422 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41e3e7-6c38-4d21-9e09-fe73810b6c41 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:12.601512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41e3e7-6c38-4d21-9e09-fe73810b6c41 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:12.634875 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f42801-6b2a-49f5-b359-e7c197c805e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:12.635479 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f42801-6b2a-49f5-b359-e7c197c805e7 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:12.635761 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f42801-6b2a-49f5-b359-e7c197c805e7 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:12.636037 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f42801-6b2a-49f5-b359-e7c197c805e7 None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:12.636691 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f42801-6b2a-49f5-b359-e7c197c805e7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:12.637000 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f42801-6b2a-49f5-b359-e7c197c805e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:12.638358 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f42801-6b2a-49f5-b359-e7c197c805e7 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:12.642922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 404/794] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Sep 24 20:34:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:34:12.648645 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cc37a-c8e8-468d-acea-eed1f73c03f2 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:12.668540 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:12.749758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cc37a-c8e8-468d-acea-eed1f73c03f2 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:12.781779 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda93df-6552-416e-bb51-038a0a6db823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:12.782379 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda93df-6552-416e-bb51-038a0a6db823 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:12.782653 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda93df-6552-416e-bb51-038a0a6db823 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:12.782919 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda93df-6552-416e-bb51-038a0a6db823 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:12.783538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda93df-6552-416e-bb51-038a0a6db823 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:12.783835 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda93df-6552-416e-bb51-038a0a6db823 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:12.785202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda93df-6552-416e-bb51-038a0a6db823 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:12.790253 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 391/795] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Sep 24 20:34:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:34:14.039459 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb9c75-b86e-4e07-8d02-b5dfd84d8ea8 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:14.039994 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb9c75-b86e-4e07-8d02-b5dfd84d8ea8 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:14.039994 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb9c75-b86e-4e07-8d02-b5dfd84d8ea8 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:14.041640 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 405/796] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:34:14.046877 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c5c66-6b84-49f4-81eb-647701e5777c None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:14.047293 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c5c66-6b84-49f4-81eb-647701e5777c None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:14.047413 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c5c66-6b84-49f4-81eb-647701e5777c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:14.065766 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-185c5c66-6b84-49f4-81eb-647701e5777c None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:34:14.066918 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-185c5c66-6b84-49f4-81eb-647701e5777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:34:14.132162 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 392/797] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:34:14 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:34:14.455909 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb9c75-b86e-4e07-8d02-b5dfd84d8ea8 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:14.509452 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:14.560787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb9c75-b86e-4e07-8d02-b5dfd84d8ea8 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:14.594740 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f41130-88e8-42f3-b629-dcd9d9b88fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:14.595346 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f41130-88e8-42f3-b629-dcd9d9b88fbd None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:14.595629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f41130-88e8-42f3-b629-dcd9d9b88fbd None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:14.595906 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f41130-88e8-42f3-b629-dcd9d9b88fbd None admin] PATH_INFO: `/v3/projects` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:14.596649 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f41130-88e8-42f3-b629-dcd9d9b88fbd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:14.597995 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f41130-88e8-42f3-b629-dcd9d9b88fbd None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:14.600639 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: WARNING keystone.server.flask.common [None req-42f41130-88e8-42f3-b629-dcd9d9b88fbd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 24 20:34:14.617473 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.sql.core [None req-42f41130-88e8-42f3-b629-dcd9d9b88fbd None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 20:34:14.617473 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 24 20:34:14.617473 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [parameters: {'id': 'ee39e0f5919f4d549f4e1909aa741fd0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 24 20:34:14.617473 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=94879) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 24 20:34:14.634340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-42f41130-88e8-42f3-b629-dcd9d9b88fbd None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ee39e0f5919f4d549f4e1909aa741fd0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ee39e0f5919f4d549f4e1909aa741fd0. Sep 24 20:34:14.634340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:14.634340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 20:34:14.634340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 20:34:14.634340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 20:34:14.634340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 20:34:14.634340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 20:34:14.634340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 20:34:14.634340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 20:34:14.634340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application conn.query(q) Sep 24 20:34:14.634340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 20:34:14.634340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 20:34:14.634340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application result.read() Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 24 20:34:14.635282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application next(self.gen) Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application yield resource Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application next(self.gen) Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self.session.rollback() Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self.force_reraise() Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise self.value Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application session.commit() Sep 24 20:34:14.636380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._prepare_impl() Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self.session.flush() Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._flush(objects) Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application compat.raise_( Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application flush_context.execute() Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 20:34:14.637353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rec.execute(self) Sep 24 20:34:14.638279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 20:34:14.638279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 24 20:34:14.638279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 20:34:14.638279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 24 20:34:14.638279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 24 20:34:14.638279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 24 20:34:14.638279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 20:34:14.638279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 20:34:14.638279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 20:34:14.638279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 24 20:34:14.638279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 20:34:14.638279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 24 20:34:14.638279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 20:34:14.638279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 24 20:34:14.638279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application conn.query(q) Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application result.read() Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 20:34:14.639086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 20:34:14.639982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 20:34:14.639982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 20:34:14.639982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 20:34:14.639982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 20:34:14.639982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 20:34:14.639982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 20:34:14.639982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 20:34:14.639982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 24 20:34:14.639982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [parameters: {'id': 'ee39e0f5919f4d549f4e1909aa741fd0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 24 20:34:14.639982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 20:34:14.639982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:14.639982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:34:14.639982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:14.639982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:14.639982 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:34:14.642272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:34:14.644276 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:34:14.644276 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 24 20:34:14.644276 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 24 20:34:14.644276 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:34:14.644276 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:34:14.644276 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 24 20:34:14.644276 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 24 20:34:14.644276 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ee39e0f5919f4d549f4e1909aa741fd0. Sep 24 20:34:14.644276 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:14.644276 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 406/798] 10.222.0.61 () {60 vars in 1140 bytes} [Sat Sep 24 20:34:14 2022] POST /identity/v3/projects => generated 262 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:34:14.645251 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c5c66-6b84-49f4-81eb-647701e5777c None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:14.656158 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:14.738643 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c5c66-6b84-49f4-81eb-647701e5777c None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:14.774765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d33790f-f4fa-4920-af45-2552d54ea494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:14.775420 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33790f-f4fa-4920-af45-2552d54ea494 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:14.775700 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33790f-f4fa-4920-af45-2552d54ea494 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:14.775973 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d33790f-f4fa-4920-af45-2552d54ea494 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:14.783568 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33790f-f4fa-4920-af45-2552d54ea494 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:14.785058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d33790f-f4fa-4920-af45-2552d54ea494 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:14.797239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-5d33790f-f4fa-4920-af45-2552d54ea494 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:34:14.797239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:14.797239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:34:14.797239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:34:14.797239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:34:14.797239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:34:14.797239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:34:14.797239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:34:14.797239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:34:14.797239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:34:14.797239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:34:14.797239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:34:14.797239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:34:14.797239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:34:14.797239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:34:14.798269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:34:14.799282 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:34:14.799282 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:34:14.799282 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:34:14.799282 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:34:14.799282 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:34:14.799282 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:34:14.799282 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:34:14.799282 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:14.799282 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 393/799] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:34:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:34:14.804895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f41130-88e8-42f3-b629-dcd9d9b88fbd None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:14.908499 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f41130-88e8-42f3-b629-dcd9d9b88fbd None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:14.917283 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:14.947658 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a4198-91cb-402a-aa82-436539b1025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:14.948262 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a4198-91cb-402a-aa82-436539b1025c None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:14.948566 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a4198-91cb-402a-aa82-436539b1025c None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:14.948844 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a4198-91cb-402a-aa82-436539b1025c None admin] PATH_INFO: `/v3/projects` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:14.949503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a4198-91cb-402a-aa82-436539b1025c None admin] RBAC: Adding query filter params (name=service) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:14.949807 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a4198-91cb-402a-aa82-436539b1025c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:14.951420 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a4198-91cb-402a-aa82-436539b1025c None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:14.971312 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 407/800] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Sep 24 20:34:14 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:34:15.196319 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c5b6a-6674-480d-83d4-fb86da06cb47 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:15.196908 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c5b6a-6674-480d-83d4-fb86da06cb47 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:15.196908 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c5b6a-6674-480d-83d4-fb86da06cb47 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:15.198220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 394/801] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:34:15.203635 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810baba-1002-4582-875d-7ce7665fc7c9 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:15.204083 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810baba-1002-4582-875d-7ce7665fc7c9 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:15.204174 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810baba-1002-4582-875d-7ce7665fc7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:15.223072 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-e810baba-1002-4582-875d-7ce7665fc7c9 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:34:15.224639 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-e810baba-1002-4582-875d-7ce7665fc7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:34:15.290137 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 408/802] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:34:15 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:34:15.613998 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c5b6a-6674-480d-83d4-fb86da06cb47 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:15.688190 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:15.721821 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c5b6a-6674-480d-83d4-fb86da06cb47 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:15.754029 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb026a5e-07b9-4e80-bdb1-4e11c1cb3665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:15.754658 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb026a5e-07b9-4e80-bdb1-4e11c1cb3665 None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:15.754935 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb026a5e-07b9-4e80-bdb1-4e11c1cb3665 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:15.755209 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb026a5e-07b9-4e80-bdb1-4e11c1cb3665 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:15.755863 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb026a5e-07b9-4e80-bdb1-4e11c1cb3665 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:15.757781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb026a5e-07b9-4e80-bdb1-4e11c1cb3665 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:15.773340 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 395/803] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Sep 24 20:34:15 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:34:17.444180 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccd7dc-36c8-47ea-9b30-c31d764e40c7 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:17.444737 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccd7dc-36c8-47ea-9b30-c31d764e40c7 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:17.444737 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccd7dc-36c8-47ea-9b30-c31d764e40c7 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:17.446019 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 409/804] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:34:17.451214 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeb326-32ab-499c-9a59-d162bfe38d2e None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:17.451592 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeb326-32ab-499c-9a59-d162bfe38d2e None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:17.451900 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eeb326-32ab-499c-9a59-d162bfe38d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:17.470550 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-f5eeb326-32ab-499c-9a59-d162bfe38d2e None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:34:17.471730 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-f5eeb326-32ab-499c-9a59-d162bfe38d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:34:17.542479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 396/805] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:34:17 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:34:17.866378 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccd7dc-36c8-47ea-9b30-c31d764e40c7 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:17.961158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:17.968840 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccd7dc-36c8-47ea-9b30-c31d764e40c7 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:18.003462 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773437b-129d-48ac-8527-22d4c8e2f865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:18.004066 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773437b-129d-48ac-8527-22d4c8e2f865 None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:18.004362 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773437b-129d-48ac-8527-22d4c8e2f865 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:18.004647 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773437b-129d-48ac-8527-22d4c8e2f865 None admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:18.005280 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773437b-129d-48ac-8527-22d4c8e2f865 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:18.006768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773437b-129d-48ac-8527-22d4c8e2f865 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:18.020586 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.sql.core [None req-2773437b-129d-48ac-8527-22d4c8e2f865 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 20:34:18.020586 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 24 20:34:18.020586 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [parameters: {'user_id': '392992c3116d40208c15ef1d906e219d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 24 20:34:18.020586 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=94879) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 24 20:34:18.027412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-2773437b-129d-48ac-8527-22d4c8e2f865 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 24 20:34:18.027412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:18.027412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 20:34:18.027412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 20:34:18.027412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 20:34:18.027412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 20:34:18.027412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 20:34:18.027412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 20:34:18.027412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 20:34:18.027412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application conn.query(q) Sep 24 20:34:18.027412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 20:34:18.027412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 20:34:18.027412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 20:34:18.027412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application result.read() Sep 24 20:34:18.027412 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 20:34:18.028522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application next(self.gen) Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application yield resource Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application next(self.gen) Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self.session.rollback() Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self.force_reraise() Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise self.value Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application session.commit() Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 24 20:34:18.029518 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._prepare_impl() Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self.session.flush() Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._flush(objects) Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application compat.raise_( Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application flush_context.execute() Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rec.execute(self) Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 20:34:18.030443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 24 20:34:18.031327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 20:34:18.031327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 24 20:34:18.031327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 24 20:34:18.031327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 24 20:34:18.031327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 20:34:18.031327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 20:34:18.031327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 20:34:18.031327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 24 20:34:18.031327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 20:34:18.031327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 24 20:34:18.031327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 20:34:18.031327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 24 20:34:18.031327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 20:34:18.031327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 20:34:18.031327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 20:34:18.031327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception Sep 24 20:34:18.032177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 20:34:18.032177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 20:34:18.032177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 20:34:18.032177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 20:34:18.032177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 20:34:18.032177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 20:34:18.032177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 20:34:18.032177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application conn.query(q) Sep 24 20:34:18.032177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 20:34:18.032177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 20:34:18.032177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 20:34:18.032177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application result.read() Sep 24 20:34:18.032177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 20:34:18.032177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 20:34:18.032177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 20:34:18.032177 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 20:34:18.033039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 20:34:18.033039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 20:34:18.033039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 20:34:18.033039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 20:34:18.033039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 20:34:18.033039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 24 20:34:18.033039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [parameters: {'user_id': '392992c3116d40208c15ef1d906e219d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 24 20:34:18.033039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 20:34:18.033039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:18.033039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:34:18.033039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:18.033039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:18.033039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:34:18.033039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:34:18.033039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 24 20:34:18.034044 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 24 20:34:18.034944 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 24 20:34:18.034944 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 24 20:34:18.034944 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 24 20:34:18.034944 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 24 20:34:18.034944 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 24 20:34:18.034944 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:18.034944 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 410/806] 10.222.0.61 () {60 vars in 1131 bytes} [Sat Sep 24 20:34:17 2022] POST /identity/v3/users => generated 160 bytes in 163 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:34:18.036248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eeb326-32ab-499c-9a59-d162bfe38d2e None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:18.093736 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:18.135781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eeb326-32ab-499c-9a59-d162bfe38d2e None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:18.171135 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53f623-acd9-45ea-bd5b-73984fd55768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:18.171774 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53f623-acd9-45ea-bd5b-73984fd55768 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:18.172058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53f623-acd9-45ea-bd5b-73984fd55768 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:18.172352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53f623-acd9-45ea-bd5b-73984fd55768 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:18.179621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53f623-acd9-45ea-bd5b-73984fd55768 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:18.181166 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53f623-acd9-45ea-bd5b-73984fd55768 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:18.194510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddb580-07f3-43bc-bb0e-a963420bfcf3 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:18.194801 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddb580-07f3-43bc-bb0e-a963420bfcf3 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:18.194905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-de53f623-acd9-45ea-bd5b-73984fd55768 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 20:34:18.194905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:18.194905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:34:18.194905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:34:18.194905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:34:18.194905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:34:18.194905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:34:18.194905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:34:18.194905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:34:18.194905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:34:18.194905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:34:18.194905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:34:18.194905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:34:18.194905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:34:18.194905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:34:18.194905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:34:18.195803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:34:18.197492 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:34:18.197492 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:34:18.197492 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:34:18.197492 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:34:18.197492 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:34:18.197492 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:34:18.197492 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:34:18.197492 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:34:18.197492 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 20:34:18.197492 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:18.198174 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddb580-07f3-43bc-bb0e-a963420bfcf3 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:18.198265 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 397/807] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:34:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:34:18.199394 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 411/808] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:34:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:34:18.201525 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53f623-acd9-45ea-bd5b-73984fd55768 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:18.204467 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6f156-3fd2-43cb-8a97-e47d7fea269e None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:18.204818 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6f156-3fd2-43cb-8a97-e47d7fea269e None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:18.205166 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6f156-3fd2-43cb-8a97-e47d7fea269e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:18.223946 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-97b6f156-3fd2-43cb-8a97-e47d7fea269e None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:34:18.225537 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-97b6f156-3fd2-43cb-8a97-e47d7fea269e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:34:18.291076 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 412/809] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:34:18 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 20:34:18.300237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53f623-acd9-45ea-bd5b-73984fd55768 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:18.317336 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:18.334956 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faaacd7-0408-4d2f-ac35-011cd469fac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:18.335558 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaacd7-0408-4d2f-ac35-011cd469fac3 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:18.335841 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaacd7-0408-4d2f-ac35-011cd469fac3 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:18.336118 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faaacd7-0408-4d2f-ac35-011cd469fac3 None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:18.336843 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faaacd7-0408-4d2f-ac35-011cd469fac3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:18.337151 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faaacd7-0408-4d2f-ac35-011cd469fac3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:18.338560 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faaacd7-0408-4d2f-ac35-011cd469fac3 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:18.372436 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 398/810] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Sep 24 20:34:18 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:34:18.635550 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6f156-3fd2-43cb-8a97-e47d7fea269e None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:18.721026 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:18.733729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6f156-3fd2-43cb-8a97-e47d7fea269e None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:18.769828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274b398-f9e4-48ff-a601-ba0b3daf92c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:18.770893 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274b398-f9e4-48ff-a601-ba0b3daf92c5 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:18.771391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274b398-f9e4-48ff-a601-ba0b3daf92c5 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:18.772533 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274b398-f9e4-48ff-a601-ba0b3daf92c5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:18.773551 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274b398-f9e4-48ff-a601-ba0b3daf92c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:18.776105 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274b398-f9e4-48ff-a601-ba0b3daf92c5 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-6274b398-f9e4-48ff-a601-ba0b3daf92c5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:34:18.786486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:34:18.787574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:34:18.787574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:34:18.787574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:34:18.787574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:34:18.787574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:34:18.787574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:34:18.787574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:34:18.787574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:34:18.787574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:34:18.787574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:34:18.787574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:34:18.787574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:34:18.787574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:34:18.787574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:34:18.787574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:34:18.787574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:34:18.788547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:34:18.788547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:34:18.788547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:34:18.788547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:34:18.788547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:34:18.788547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:34:18.788547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:34:18.788547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:34:18.788547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:34:18.788547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:34:18.788547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:34:18.788547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:34:18.788547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 20:34:18.788547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:34:18.788547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 413/811] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:34:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:34:18.793964 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faaacd7-0408-4d2f-ac35-011cd469fac3 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:18.888711 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faaacd7-0408-4d2f-ac35-011cd469fac3 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:18.921044 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58ea4a-d9a7-4d0e-a8c4-e919de47e181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:18.921631 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58ea4a-d9a7-4d0e-a8c4-e919de47e181 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:18.921909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58ea4a-d9a7-4d0e-a8c4-e919de47e181 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:18.922179 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db58ea4a-d9a7-4d0e-a8c4-e919de47e181 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:18.922788 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58ea4a-d9a7-4d0e-a8c4-e919de47e181 None admin] RBAC: Adding query filter params (name=compute) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:18.923087 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58ea4a-d9a7-4d0e-a8c4-e919de47e181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:18.924446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db58ea4a-d9a7-4d0e-a8c4-e919de47e181 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:18.928973 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 399/812] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Sep 24 20:34:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:34:18.934587 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274b398-f9e4-48ff-a601-ba0b3daf92c5 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:19.032635 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274b398-f9e4-48ff-a601-ba0b3daf92c5 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:19.065547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a35d7-d699-49e4-9502-4609e0d02c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:19.066146 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a35d7-d699-49e4-9502-4609e0d02c16 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:19.066426 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a35d7-d699-49e4-9502-4609e0d02c16 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:19.066699 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a35d7-d699-49e4-9502-4609e0d02c16 None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:19.067398 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a35d7-d699-49e4-9502-4609e0d02c16 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:19.067704 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a35d7-d699-49e4-9502-4609e0d02c16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:19.069102 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a35d7-d699-49e4-9502-4609e0d02c16 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:19.073939 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 414/813] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Sep 24 20:34:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:34:19.079855 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58ea4a-d9a7-4d0e-a8c4-e919de47e181 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:19.121611 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:19.182340 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db58ea4a-d9a7-4d0e-a8c4-e919de47e181 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:19.215879 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d534a-8bb9-4cbd-8acd-c881b8a67191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:19.216514 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d534a-8bb9-4cbd-8acd-c881b8a67191 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:19.216794 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d534a-8bb9-4cbd-8acd-c881b8a67191 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:19.217068 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d534a-8bb9-4cbd-8acd-c881b8a67191 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:19.217754 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d534a-8bb9-4cbd-8acd-c881b8a67191 None admin] RBAC: Adding query filter params (interface=public, service_id=a996f93391204035a594be133caef458, region_id=RegionOne) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:19.218083 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d534a-8bb9-4cbd-8acd-c881b8a67191 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:19.219420 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d534a-8bb9-4cbd-8acd-c881b8a67191 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:19.224373 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 400/814] 10.222.0.61 () {56 vars in 1251 bytes} [Sat Sep 24 20:34:19 2022] GET /identity/v3/endpoints?service_id=a996f93391204035a594be133caef458&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:34:19.230570 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a35d7-d699-49e4-9502-4609e0d02c16 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:19.248657 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:19.327169 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a35d7-d699-49e4-9502-4609e0d02c16 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:19.359898 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187bd47-2ba0-43d3-bd8c-e39d003f22fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:19.360523 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187bd47-2ba0-43d3-bd8c-e39d003f22fd None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:19.360803 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187bd47-2ba0-43d3-bd8c-e39d003f22fd None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:19.361074 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187bd47-2ba0-43d3-bd8c-e39d003f22fd None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:19.361661 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187bd47-2ba0-43d3-bd8c-e39d003f22fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:19.363015 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187bd47-2ba0-43d3-bd8c-e39d003f22fd None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:19.369016 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 415/815] 10.222.0.61 () {56 vars in 1087 bytes} [Sat Sep 24 20:34:19 2022] GET /identity/v3/services => generated 1728 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:34:21.729441 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4f482-3fab-49f1-8805-fe87e50d1003 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:21.729963 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4f482-3fab-49f1-8805-fe87e50d1003 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:21.729963 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4f482-3fab-49f1-8805-fe87e50d1003 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:21.731285 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 401/816] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:34:21.736728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f259e-7b36-4000-ae29-09dbf25a02c2 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:21.737121 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f259e-7b36-4000-ae29-09dbf25a02c2 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:21.737282 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f259e-7b36-4000-ae29-09dbf25a02c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:21.755650 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-755f259e-7b36-4000-ae29-09dbf25a02c2 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:34:21.756895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-755f259e-7b36-4000-ae29-09dbf25a02c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:34:21.822042 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 416/817] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:34:21 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:34:22.142936 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4f482-3fab-49f1-8805-fe87e50d1003 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:22.242586 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4f482-3fab-49f1-8805-fe87e50d1003 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:22.245299 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:22.276769 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fcbd5-5f19-42a9-b954-c6a1b3fe48f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:22.277385 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fcbd5-5f19-42a9-b954-c6a1b3fe48f9 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:22.277659 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fcbd5-5f19-42a9-b954-c6a1b3fe48f9 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:22.277927 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fcbd5-5f19-42a9-b954-c6a1b3fe48f9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:22.278495 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fcbd5-5f19-42a9-b954-c6a1b3fe48f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:22.279834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fcbd5-5f19-42a9-b954-c6a1b3fe48f9 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-d42fcbd5-5f19-42a9-b954-c6a1b3fe48f9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:34:22.288248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:34:22.289446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:34:22.289446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:34:22.289446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:34:22.289446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:34:22.289446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:34:22.289446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:34:22.289446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:34:22.289446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:34:22.289446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:34:22.289446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:34:22.289446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:34:22.289446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:34:22.289446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:34:22.289446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:34:22.289446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:34:22.289446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:34:22.290316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:34:22.290316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:34:22.290316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:34:22.290316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:34:22.290316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:34:22.290316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:34:22.290316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:34:22.290316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:34:22.290316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:34:22.290316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:34:22.290316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:34:22.290316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:34:22.290316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 20:34:22.290316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:34:22.290316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 402/818] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:34:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:34:22.295724 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f259e-7b36-4000-ae29-09dbf25a02c2 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:22.307566 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:22.392243 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f259e-7b36-4000-ae29-09dbf25a02c2 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:22.430224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036d65a-4c92-411c-9d30-f7e1e94b7b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:22.430829 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d65a-4c92-411c-9d30-f7e1e94b7b7d None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:22.431110 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d65a-4c92-411c-9d30-f7e1e94b7b7d None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:22.431413 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d65a-4c92-411c-9d30-f7e1e94b7b7d None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:22.432035 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036d65a-4c92-411c-9d30-f7e1e94b7b7d None admin] RBAC: Adding query filter params (name=compute) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:22.432395 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036d65a-4c92-411c-9d30-f7e1e94b7b7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:22.433767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036d65a-4c92-411c-9d30-f7e1e94b7b7d None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:22.438407 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 417/819] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Sep 24 20:34:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:34:22.444882 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fcbd5-5f19-42a9-b954-c6a1b3fe48f9 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:22.548116 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fcbd5-5f19-42a9-b954-c6a1b3fe48f9 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:22.581011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e149e-e4c5-4a84-8b77-81f2a7c8a727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:22.581610 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e149e-e4c5-4a84-8b77-81f2a7c8a727 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:22.581892 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e149e-e4c5-4a84-8b77-81f2a7c8a727 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:22.582166 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e149e-e4c5-4a84-8b77-81f2a7c8a727 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:22.582782 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e149e-e4c5-4a84-8b77-81f2a7c8a727 None admin] RBAC: Adding query filter params (type=compute) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:34:22.583089 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e149e-e4c5-4a84-8b77-81f2a7c8a727 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:22.585098 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e149e-e4c5-4a84-8b77-81f2a7c8a727 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:22.589728 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 403/820] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Sep 24 20:34:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:34:22.595603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036d65a-4c92-411c-9d30-f7e1e94b7b7d None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:34:22.668122 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:22.692618 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036d65a-4c92-411c-9d30-f7e1e94b7b7d None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:34:22.725946 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54bfc44-36c9-49b6-9da9-7f831a345186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:34:22.726543 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bfc44-36c9-49b6-9da9-7f831a345186 None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:34:22.726824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bfc44-36c9-49b6-9da9-7f831a345186 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:34:22.727099 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54bfc44-36c9-49b6-9da9-7f831a345186 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:34:22.727760 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bfc44-36c9-49b6-9da9-7f831a345186 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:34:22.729135 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54bfc44-36c9-49b6-9da9-7f831a345186 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:34:22.748616 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 418/821] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Sep 24 20:34:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:34:32.587445 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=84 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:34:32.744215 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:26.125011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da252e15-16b1-4944-8c3c-367dbee01c32 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:26.125659 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da252e15-16b1-4944-8c3c-367dbee01c32 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:26.125767 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da252e15-16b1-4944-8c3c-367dbee01c32 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:26.128301 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 404/822] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:35:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:35:26.136169 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998f46-1341-4011-8e9f-bd8de280d27e None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:26.136720 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998f46-1341-4011-8e9f-bd8de280d27e None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:26.136827 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998f46-1341-4011-8e9f-bd8de280d27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:26.160450 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-de998f46-1341-4011-8e9f-bd8de280d27e None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:35:26.160450 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-de998f46-1341-4011-8e9f-bd8de280d27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:35:26.254193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 419/823] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:35:26 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:35:26.577261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da252e15-16b1-4944-8c3c-367dbee01c32 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:26.715793 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da252e15-16b1-4944-8c3c-367dbee01c32 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:26.763126 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfacb04-3180-4f29-bc89-dd7c46a00b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:26.763785 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfacb04-3180-4f29-bc89-dd7c46a00b92 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:26.764046 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfacb04-3180-4f29-bc89-dd7c46a00b92 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:26.764354 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfacb04-3180-4f29-bc89-dd7c46a00b92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:26.777798 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfacb04-3180-4f29-bc89-dd7c46a00b92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:26.779305 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfacb04-3180-4f29-bc89-dd7c46a00b92 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:26.797664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-2bfacb04-3180-4f29-bc89-dd7c46a00b92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:26.797664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:26.797664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:26.797664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:26.797664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:26.797664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:26.797664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:26.797664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:26.797664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:26.797664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:26.797664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:26.797664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:26.797664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:35:26.797664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:35:26.797664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:35:26.797664 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:26.798947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:35:26.800143 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:35:26.800143 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:26.800143 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:35:26.800143 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 405/824] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:26.805852 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de998f46-1341-4011-8e9f-bd8de280d27e None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:26.935966 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de998f46-1341-4011-8e9f-bd8de280d27e None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:26.968723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:26.982260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd336c9-3032-4e3f-8fd0-8dd212336aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:26.982885 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd336c9-3032-4e3f-8fd0-8dd212336aa4 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:26.983221 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd336c9-3032-4e3f-8fd0-8dd212336aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:26.983477 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd336c9-3032-4e3f-8fd0-8dd212336aa4 None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:26.985152 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd336c9-3032-4e3f-8fd0-8dd212336aa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:26.985152 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd336c9-3032-4e3f-8fd0-8dd212336aa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:26.986254 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd336c9-3032-4e3f-8fd0-8dd212336aa4 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:27.001167 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 420/825] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:27.007626 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfacb04-3180-4f29-bc89-dd7c46a00b92 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:27.080316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:27.145414 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfacb04-3180-4f29-bc89-dd7c46a00b92 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:27.183935 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599fda5-7fea-46ce-b8de-738dcb6db721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:27.184643 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599fda5-7fea-46ce-b8de-738dcb6db721 None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:27.184931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599fda5-7fea-46ce-b8de-738dcb6db721 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:27.185212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599fda5-7fea-46ce-b8de-738dcb6db721 None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:27.185871 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599fda5-7fea-46ce-b8de-738dcb6db721 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:27.187355 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599fda5-7fea-46ce-b8de-738dcb6db721 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:27.210204 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 406/826] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Sep 24 20:35:27 2022] POST /identity/v3/users => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:35:29.789083 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db91671-8a4a-4310-9d91-d2cfd550a96a None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:29.789638 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db91671-8a4a-4310-9d91-d2cfd550a96a None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:29.789734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db91671-8a4a-4310-9d91-d2cfd550a96a None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:29.791410 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 421/827] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:35:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:35:29.797327 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcf2d9-8194-4e65-9266-dda08b78b524 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:29.798902 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcf2d9-8194-4e65-9266-dda08b78b524 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:29.798902 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcf2d9-8194-4e65-9266-dda08b78b524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:29.820148 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-0ebcf2d9-8194-4e65-9266-dda08b78b524 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:35:29.821537 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-0ebcf2d9-8194-4e65-9266-dda08b78b524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:35:29.890670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 407/828] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:35:29 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 20:35:30.235454 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db91671-8a4a-4310-9d91-d2cfd550a96a None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:30.342986 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db91671-8a4a-4310-9d91-d2cfd550a96a None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:30.378629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27874e2b-e32a-4535-989e-6251fc433b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:30.379257 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27874e2b-e32a-4535-989e-6251fc433b99 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:30.379535 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27874e2b-e32a-4535-989e-6251fc433b99 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:30.379839 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27874e2b-e32a-4535-989e-6251fc433b99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:30.391591 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27874e2b-e32a-4535-989e-6251fc433b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:35:30.398071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-27874e2b-e32a-4535-989e-6251fc433b99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:35:30.398071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:30.398071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:30.398071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:30.398071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:30.398071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:30.398071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:30.398071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:30.398071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:30.398071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:30.398071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:30.398071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:30.398071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:35:30.398071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:35:30.398071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:35:30.398071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:35:30.399260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:35:30.399260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:35:30.399260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:35:30.399260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:35:30.399260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:30.399260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:30.399260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:30.399260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:30.399260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:30.399260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:30.399260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:30.399260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:30.399260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:30.399260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:30.399260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:30.399260 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:30.400316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:30.400316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:30.400316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:30.400316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:30.400316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:35:30.400316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:35:30.400316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:35:30.400316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:35:30.400316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:35:30.400316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:35:30.400316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:35:30.400316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:35:30.400316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 422/829] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:35:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:30.405239 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcf2d9-8194-4e65-9266-dda08b78b524 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:30.448138 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:30.512131 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcf2d9-8194-4e65-9266-dda08b78b524 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:30.548840 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3937e-3367-4303-9d76-9c189119f01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:30.550021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3937e-3367-4303-9d76-9c189119f01a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:30.550240 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3937e-3367-4303-9d76-9c189119f01a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:30.550559 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3937e-3367-4303-9d76-9c189119f01a None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:30.551219 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3937e-3367-4303-9d76-9c189119f01a None admin] RBAC: Adding query filter params (name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:30.551518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3937e-3367-4303-9d76-9c189119f01a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:30.552940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3937e-3367-4303-9d76-9c189119f01a None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:30.561673 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 408/830] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Sep 24 20:35:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:30.567719 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27874e2b-e32a-4535-989e-6251fc433b99 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:30.620884 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:30.681504 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27874e2b-e32a-4535-989e-6251fc433b99 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:30.729496 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da95ce9-06f2-4795-8107-61f43059ca15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:30.730163 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da95ce9-06f2-4795-8107-61f43059ca15 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:30.730538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da95ce9-06f2-4795-8107-61f43059ca15 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:30.730893 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da95ce9-06f2-4795-8107-61f43059ca15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:30.744451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da95ce9-06f2-4795-8107-61f43059ca15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:30.746228 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da95ce9-06f2-4795-8107-61f43059ca15 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:30.762340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-5da95ce9-06f2-4795-8107-61f43059ca15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:30.762340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:30.762340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:30.762340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:30.762340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:30.762340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:30.762340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:30.762340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:30.762340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:30.762340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:30.762340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:30.762340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:30.762340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:35:30.762340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:35:30.762340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:35:30.762340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:30.764472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:35:30.767314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:35:30.767314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:30.767314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:35:30.767314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 423/831] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:30.770579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3937e-3367-4303-9d76-9c189119f01a None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:30.881654 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:30.884740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3937e-3367-4303-9d76-9c189119f01a None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:30.922035 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a4121-2ab7-47b0-829e-4685f091498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:30.922643 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a4121-2ab7-47b0-829e-4685f091498c None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:30.922917 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a4121-2ab7-47b0-829e-4685f091498c None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:30.923276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a4121-2ab7-47b0-829e-4685f091498c None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:30.923909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a4121-2ab7-47b0-829e-4685f091498c None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:30.924283 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a4121-2ab7-47b0-829e-4685f091498c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:30.925665 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a4121-2ab7-47b0-829e-4685f091498c None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:30.944274 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 409/832] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:30.945633 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da95ce9-06f2-4795-8107-61f43059ca15 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:31.058770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:31.062628 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da95ce9-06f2-4795-8107-61f43059ca15 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:31.100203 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f5ee0-d01b-4f73-8997-c50763411ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:31.100945 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5ee0-d01b-4f73-8997-c50763411ec5 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:31.101278 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5ee0-d01b-4f73-8997-c50763411ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:31.101548 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f5ee0-d01b-4f73-8997-c50763411ec5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:31.109226 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f5ee0-d01b-4f73-8997-c50763411ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:31.110768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f5ee0-d01b-4f73-8997-c50763411ec5 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:31.123380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-0e4f5ee0-d01b-4f73-8997-c50763411ec5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 20:35:31.123380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:31.123380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:31.123380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:31.123380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:31.123380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:31.123380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:31.123380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:31.123380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:31.123380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:31.123380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:31.123380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:31.123380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:35:31.123380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:35:31.123380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:35:31.123380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:31.129319 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:31.130497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:31.130497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:31.130497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:35:31.130497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:35:31.130497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:35:31.130497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:35:31.130497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:35:31.130497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:35:31.130497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 20:35:31.130497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:35:31.130497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 424/833] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:35:31.131352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a4121-2ab7-47b0-829e-4685f091498c None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:31.240013 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a4121-2ab7-47b0-829e-4685f091498c None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:31.274978 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6814229-605f-4f02-ac35-cf83b7038955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:31.275583 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6814229-605f-4f02-ac35-cf83b7038955 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:31.275860 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6814229-605f-4f02-ac35-cf83b7038955 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:31.276121 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6814229-605f-4f02-ac35-cf83b7038955 None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:31.276867 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6814229-605f-4f02-ac35-cf83b7038955 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:31.277173 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6814229-605f-4f02-ac35-cf83b7038955 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:31.278575 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6814229-605f-4f02-ac35-cf83b7038955 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:31.296093 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 410/834] 10.222.0.61 () {56 vars in 1143 bytes} [Sat Sep 24 20:35:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:35:31.307312 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f5ee0-d01b-4f73-8997-c50763411ec5 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:31.427113 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f5ee0-d01b-4f73-8997-c50763411ec5 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:31.461201 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c453f-15ed-43b4-890c-ae588c69fe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:31.461817 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c453f-15ed-43b4-890c-ae588c69fe78 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:31.462099 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c453f-15ed-43b4-890c-ae588c69fe78 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:31.462375 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c453f-15ed-43b4-890c-ae588c69fe78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:31.491359 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:31.534147 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c453f-15ed-43b4-890c-ae588c69fe78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:31.535954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c453f-15ed-43b4-890c-ae588c69fe78 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:31.642977 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 425/835] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:35:31 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 20:35:31.649119 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6814229-605f-4f02-ac35-cf83b7038955 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:31.668750 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:31.756113 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6814229-605f-4f02-ac35-cf83b7038955 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:31.796708 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3522b4-7503-40d8-bd05-57e930702c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:31.797465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3522b4-7503-40d8-bd05-57e930702c06 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:31.797809 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3522b4-7503-40d8-bd05-57e930702c06 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:31.798116 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3522b4-7503-40d8-bd05-57e930702c06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:31.810190 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3522b4-7503-40d8-bd05-57e930702c06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:31.811913 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3522b4-7503-40d8-bd05-57e930702c06 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:31.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-1a3522b4-7503-40d8-bd05-57e930702c06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:31.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:31.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:31.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:31.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:31.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:31.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:31.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:31.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:31.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:31.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:31.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:31.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:35:31.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:35:31.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:35:31.827096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:31.828418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:35:31.829621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:35:31.829621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:31.829621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:35:31.829621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 411/836] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:31.834654 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c453f-15ed-43b4-890c-ae588c69fe78 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:31.896136 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:31.942398 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c453f-15ed-43b4-890c-ae588c69fe78 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:31.980091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc20d5-dced-4403-9a5b-6eeda66f7d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:31.981190 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc20d5-dced-4403-9a5b-6eeda66f7d61 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:31.981190 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc20d5-dced-4403-9a5b-6eeda66f7d61 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:31.981510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc20d5-dced-4403-9a5b-6eeda66f7d61 None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:31.981900 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc20d5-dced-4403-9a5b-6eeda66f7d61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:31.982194 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc20d5-dced-4403-9a5b-6eeda66f7d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:31.983743 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc20d5-dced-4403-9a5b-6eeda66f7d61 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:31.998208 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 426/837] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:32.005318 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3522b4-7503-40d8-bd05-57e930702c06 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:32.078758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:32.110784 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3522b4-7503-40d8-bd05-57e930702c06 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:32.148920 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893c756-ad7e-451b-b331-ad612e3c61d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:32.149679 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893c756-ad7e-451b-b331-ad612e3c61d1 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:32.149964 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893c756-ad7e-451b-b331-ad612e3c61d1 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:32.150341 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893c756-ad7e-451b-b331-ad612e3c61d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:32.159151 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893c756-ad7e-451b-b331-ad612e3c61d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:32.161296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893c756-ad7e-451b-b331-ad612e3c61d1 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:32.172740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-a893c756-ad7e-451b-b331-ad612e3c61d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:35:32.172740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:32.172740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:32.172740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:32.172740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:32.172740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:32.172740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:32.172740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:32.172740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:32.172740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:32.172740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:32.172740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:32.172740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:35:32.172740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:35:32.172740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:32.173828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:32.175666 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:35:32.175666 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:35:32.175666 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:35:32.175666 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:35:32.175666 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:35:32.175666 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:35:32.175666 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:35:32.175666 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:35:32.175666 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 412/838] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:35:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:35:32.180511 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc20d5-dced-4403-9a5b-6eeda66f7d61 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:32.295814 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc20d5-dced-4403-9a5b-6eeda66f7d61 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:32.317031 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:32.335974 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ea0fb8-aa6d-4470-8cc9-a7bd59614e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:32.336812 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea0fb8-aa6d-4470-8cc9-a7bd59614e99 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:32.337096 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea0fb8-aa6d-4470-8cc9-a7bd59614e99 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:32.337366 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea0fb8-aa6d-4470-8cc9-a7bd59614e99 None admin] PATH_INFO: `/v3/projects` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:32.338043 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea0fb8-aa6d-4470-8cc9-a7bd59614e99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:32.338342 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea0fb8-aa6d-4470-8cc9-a7bd59614e99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:32.339763 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ea0fb8-aa6d-4470-8cc9-a7bd59614e99 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:32.354871 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 427/839] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:35:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:35:32.361142 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893c756-ad7e-451b-b331-ad612e3c61d1 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:32.471625 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893c756-ad7e-451b-b331-ad612e3c61d1 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:32.499757 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:32.505928 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ef6be-65f6-4b62-b3ea-44ad38de8c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:32.506658 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ef6be-65f6-4b62-b3ea-44ad38de8c3f None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:32.507008 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ef6be-65f6-4b62-b3ea-44ad38de8c3f None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:32.507356 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ef6be-65f6-4b62-b3ea-44ad38de8c3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:32.508143 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ef6be-65f6-4b62-b3ea-44ad38de8c3f None admin] RBAC: Adding query filter params (role.id=6e079191d798481b811c5c8dca0c0f7a, scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341, user.id=d3060c5a247f495990fd7eec99c0ee0a) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:32.508557 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ef6be-65f6-4b62-b3ea-44ad38de8c3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:32.509979 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ef6be-65f6-4b62-b3ea-44ad38de8c3f None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:32.515338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 413/840] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:35:32 2022] GET /identity/v3/role_assignments?user.id=d3060c5a247f495990fd7eec99c0ee0a&scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341&role.id=6e079191d798481b811c5c8dca0c0f7a => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:34.988145 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfb9de-aab7-49fa-9670-d26f6b8d10ad None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:34.988772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfb9de-aab7-49fa-9670-d26f6b8d10ad None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:34.988926 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfb9de-aab7-49fa-9670-d26f6b8d10ad None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:34.990463 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 428/841] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:35:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:35:34.996691 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd636d-35d0-48e9-b2a9-627644a7b668 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:34.997186 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd636d-35d0-48e9-b2a9-627644a7b668 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:34.997279 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd636d-35d0-48e9-b2a9-627644a7b668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:35.020213 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-28dd636d-35d0-48e9-b2a9-627644a7b668 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:35:35.021644 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-28dd636d-35d0-48e9-b2a9-627644a7b668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:35:35.098115 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 414/842] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:35:34 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:35:35.440930 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfb9de-aab7-49fa-9670-d26f6b8d10ad None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:35.553851 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfb9de-aab7-49fa-9670-d26f6b8d10ad None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:35.588325 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a29674-5573-49ee-a527-5778138dc6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:35.589016 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a29674-5573-49ee-a527-5778138dc6ba None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:35.589273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a29674-5573-49ee-a527-5778138dc6ba None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:35.589545 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a29674-5573-49ee-a527-5778138dc6ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:35.599795 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a29674-5573-49ee-a527-5778138dc6ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:35:35.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-e0a29674-5573-49ee-a527-5778138dc6ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:35:35.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:35.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:35.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:35.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:35.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:35.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:35.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:35.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:35.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:35.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:35.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:35.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:35:35.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:35:35.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:35:35.604811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:35:35.605794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:35:35.605794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:35:35.605794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:35:35.605794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:35:35.605794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:35.605794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:35.605794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:35.605794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:35.605794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:35.605794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:35.605794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:35.605794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:35.605794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:35.605794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:35.605794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:35.605794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:35.606629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:35.606629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:35.606629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:35.606629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:35.606629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:35:35.606629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:35:35.606629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:35:35.606629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:35:35.606629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:35:35.606629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:35:35.606629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:35:35.606629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:35:35.606629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 429/843] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:35:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:35.612740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd636d-35d0-48e9-b2a9-627644a7b668 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:35.723676 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd636d-35d0-48e9-b2a9-627644a7b668 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:35.751674 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:35.765114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565f3cd-b67f-47e1-8916-65e31b902003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:35.765730 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565f3cd-b67f-47e1-8916-65e31b902003 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:35.766101 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565f3cd-b67f-47e1-8916-65e31b902003 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:35.766300 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565f3cd-b67f-47e1-8916-65e31b902003 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:35.767106 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565f3cd-b67f-47e1-8916-65e31b902003 None admin] RBAC: Adding query filter params (name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:35.767458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565f3cd-b67f-47e1-8916-65e31b902003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:35.768837 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565f3cd-b67f-47e1-8916-65e31b902003 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:35.777037 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 415/844] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Sep 24 20:35:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:35.784240 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a29674-5573-49ee-a527-5778138dc6ba None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:35.839227 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:35.910122 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a29674-5573-49ee-a527-5778138dc6ba None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:35.946657 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d94c8c-0380-4f3e-b1fe-17190027f889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:35.947290 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d94c8c-0380-4f3e-b1fe-17190027f889 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:35.947570 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d94c8c-0380-4f3e-b1fe-17190027f889 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:35.947840 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d94c8c-0380-4f3e-b1fe-17190027f889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:35.958323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d94c8c-0380-4f3e-b1fe-17190027f889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:35.959850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d94c8c-0380-4f3e-b1fe-17190027f889 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:35.975425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-d8d94c8c-0380-4f3e-b1fe-17190027f889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:35.975425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:35.975425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:35.975425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:35.975425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:35.975425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:35.975425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:35.975425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:35.975425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:35.975425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:35.975425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:35.975425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:35.975425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:35:35.975425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:35:35.975425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:35:35.975425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:35.976484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:35:35.977418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:35:35.977418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:35.977418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:35:35.977418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 430/845] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:35.982178 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565f3cd-b67f-47e1-8916-65e31b902003 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:36.089186 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565f3cd-b67f-47e1-8916-65e31b902003 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:36.127751 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d8cab-f0eb-42df-b902-9af225e451f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:36.128395 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d8cab-f0eb-42df-b902-9af225e451f9 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:36.128726 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d8cab-f0eb-42df-b902-9af225e451f9 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:36.128959 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d8cab-f0eb-42df-b902-9af225e451f9 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:36.129675 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d8cab-f0eb-42df-b902-9af225e451f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:36.129927 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d8cab-f0eb-42df-b902-9af225e451f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:36.131295 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d8cab-f0eb-42df-b902-9af225e451f9 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:36.144436 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 416/846] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:36.150094 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d94c8c-0380-4f3e-b1fe-17190027f889 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:36.258687 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:36.270884 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d94c8c-0380-4f3e-b1fe-17190027f889 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:36.306338 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb9d14-d923-47b0-8d1b-57fcfd13bf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:36.306963 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb9d14-d923-47b0-8d1b-57fcfd13bf59 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:36.307243 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb9d14-d923-47b0-8d1b-57fcfd13bf59 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:36.307516 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb9d14-d923-47b0-8d1b-57fcfd13bf59 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:36.315672 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb9d14-d923-47b0-8d1b-57fcfd13bf59 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:36.317132 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb9d14-d923-47b0-8d1b-57fcfd13bf59 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:36.328418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-9feb9d14-d923-47b0-8d1b-57fcfd13bf59 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 20:35:36.328418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:36.328418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:36.328418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:36.328418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:36.328418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:36.328418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:36.328418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:36.328418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:36.328418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:36.328418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:36.328418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:36.328418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:35:36.328418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:35:36.328418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:35:36.328418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:36.329846 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:36.330962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:36.330962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:36.330962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:35:36.330962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:35:36.330962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:35:36.330962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:35:36.330962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:35:36.330962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:35:36.330962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 20:35:36.330962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:35:36.330962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 431/847] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:36.335620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d8cab-f0eb-42df-b902-9af225e451f9 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:36.385903 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:36.437985 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d8cab-f0eb-42df-b902-9af225e451f9 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:36.474859 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995ea7a-5615-43b3-a65e-7be9102a97a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:36.475568 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995ea7a-5615-43b3-a65e-7be9102a97a5 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:36.475946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995ea7a-5615-43b3-a65e-7be9102a97a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:36.476271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995ea7a-5615-43b3-a65e-7be9102a97a5 None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:36.477198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995ea7a-5615-43b3-a65e-7be9102a97a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:36.477543 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995ea7a-5615-43b3-a65e-7be9102a97a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:36.479250 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995ea7a-5615-43b3-a65e-7be9102a97a5 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:36.498028 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 417/848] 10.222.0.61 () {56 vars in 1143 bytes} [Sat Sep 24 20:35:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:36.503138 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb9d14-d923-47b0-8d1b-57fcfd13bf59 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:36.615599 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb9d14-d923-47b0-8d1b-57fcfd13bf59 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:36.651636 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3117f-fea3-4f97-a6eb-190706a7584c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:36.652268 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3117f-fea3-4f97-a6eb-190706a7584c None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:36.652579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3117f-fea3-4f97-a6eb-190706a7584c None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:36.652852 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3117f-fea3-4f97-a6eb-190706a7584c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:36.664395 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3117f-fea3-4f97-a6eb-190706a7584c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:36.666336 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3117f-fea3-4f97-a6eb-190706a7584c None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:36.683193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-1bf3117f-fea3-4f97-a6eb-190706a7584c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:36.683193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:36.683193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:36.683193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:36.683193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:36.683193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:36.683193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:36.683193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:36.683193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:36.683193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:36.683193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:36.683193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:36.683193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:35:36.683193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:35:36.683193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:35:36.683193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:36.684323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:35:36.685289 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:35:36.685289 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:36.685289 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:35:36.685289 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 432/849] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:35:36.690346 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995ea7a-5615-43b3-a65e-7be9102a97a5 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:36.798142 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995ea7a-5615-43b3-a65e-7be9102a97a5 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:36.800931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:36.837630 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceae6f-8827-4848-be9f-455e814d97c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:36.838240 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceae6f-8827-4848-be9f-455e814d97c0 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:36.838576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceae6f-8827-4848-be9f-455e814d97c0 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:36.838811 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceae6f-8827-4848-be9f-455e814d97c0 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:36.839429 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ceae6f-8827-4848-be9f-455e814d97c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:36.839735 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ceae6f-8827-4848-be9f-455e814d97c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:36.841138 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ceae6f-8827-4848-be9f-455e814d97c0 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:36.853256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 418/850] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:36.858874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3117f-fea3-4f97-a6eb-190706a7584c None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:36.862069 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:36.965991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3117f-fea3-4f97-a6eb-190706a7584c None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:37.004736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325256eb-6187-4f8f-b210-f440b0810eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:37.005501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325256eb-6187-4f8f-b210-f440b0810eb9 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:37.005812 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325256eb-6187-4f8f-b210-f440b0810eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:37.006198 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325256eb-6187-4f8f-b210-f440b0810eb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:37.014032 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325256eb-6187-4f8f-b210-f440b0810eb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:37.015828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325256eb-6187-4f8f-b210-f440b0810eb9 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:37.028822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-325256eb-6187-4f8f-b210-f440b0810eb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:35:37.028822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:37.028822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:37.028822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:37.028822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:37.028822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:37.028822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:37.028822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:37.028822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:37.028822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:37.028822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:37.028822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:37.028822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:35:37.028822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:35:37.028822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:37.030080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:37.031241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:35:37.031241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:35:37.031241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:35:37.031241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:35:37.031241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:35:37.031241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:35:37.031241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:35:37.031241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:35:37.031241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 433/851] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 20:35:37.037585 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceae6f-8827-4848-be9f-455e814d97c0 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:37.166316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceae6f-8827-4848-be9f-455e814d97c0 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:37.208544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbfa010-59ec-4bea-ac92-2df9efaab624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:37.209195 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfa010-59ec-4bea-ac92-2df9efaab624 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:37.209508 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfa010-59ec-4bea-ac92-2df9efaab624 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:37.209821 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbfa010-59ec-4bea-ac92-2df9efaab624 None admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:37.210682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbfa010-59ec-4bea-ac92-2df9efaab624 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:37.211049 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbfa010-59ec-4bea-ac92-2df9efaab624 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:37.212753 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbfa010-59ec-4bea-ac92-2df9efaab624 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:37.227293 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 419/852] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:35:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:37.234641 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325256eb-6187-4f8f-b210-f440b0810eb9 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:37.303022 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:37.343687 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325256eb-6187-4f8f-b210-f440b0810eb9 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:37.379718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7db09-3c83-4cb2-8ce5-3e6b07e81abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:37.380403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7db09-3c83-4cb2-8ce5-3e6b07e81abc None admin] REQUEST_METHOD: `PUT` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:37.380690 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7db09-3c83-4cb2-8ce5-3e6b07e81abc None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:37.380965 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7db09-3c83-4cb2-8ce5-3e6b07e81abc None admin] PATH_INFO: `/v3/projects/6e446dc5c12d49bca59e6e8c8ad90341/users/d3060c5a247f495990fd7eec99c0ee0a/roles/6e079191d798481b811c5c8dca0c0f7a` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:37.396711 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7db09-3c83-4cb2-8ce5-3e6b07e81abc None admin] RBAC: Authorizing `identity:create_grant(project_id=6e446dc5c12d49bca59e6e8c8ad90341, user_id=d3060c5a247f495990fd7eec99c0ee0a, role_id=6e079191d798481b811c5c8dca0c0f7a)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:37.398494 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7db09-3c83-4cb2-8ce5-3e6b07e81abc None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:37.417815 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 434/853] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Sep 24 20:35:37 2022] PUT /identity/v3/projects/6e446dc5c12d49bca59e6e8c8ad90341/users/d3060c5a247f495990fd7eec99c0ee0a/roles/6e079191d798481b811c5c8dca0c0f7a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:35:40.054871 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb19536-e7a3-43c2-b51f-bc8f142a7936 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:40.055423 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb19536-e7a3-43c2-b51f-bc8f142a7936 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:40.055423 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb19536-e7a3-43c2-b51f-bc8f142a7936 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:40.057054 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 420/854] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:35:40.063644 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fb109-9a8a-46ce-93f1-e2829fe2786d None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:40.064095 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fb109-9a8a-46ce-93f1-e2829fe2786d None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:40.064238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fb109-9a8a-46ce-93f1-e2829fe2786d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:40.084559 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-bf6fb109-9a8a-46ce-93f1-e2829fe2786d None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:35:40.085923 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-bf6fb109-9a8a-46ce-93f1-e2829fe2786d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:35:40.172667 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 435/855] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:35:40 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:35:40.545008 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb19536-e7a3-43c2-b51f-bc8f142a7936 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:40.575066 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:40.674753 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb19536-e7a3-43c2-b51f-bc8f142a7936 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:40.713437 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c314c-2113-4b48-a6fc-c876befb422a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:40.714067 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c314c-2113-4b48-a6fc-c876befb422a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:40.714351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c314c-2113-4b48-a6fc-c876befb422a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:40.714630 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c314c-2113-4b48-a6fc-c876befb422a None admin] PATH_INFO: `/v3/roles/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:40.726307 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c314c-2113-4b48-a6fc-c876befb422a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:35:40.731104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-5d6c314c-2113-4b48-a6fc-c876befb422a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:35:40.731104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:40.731104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:40.731104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:40.731104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:40.731104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:40.731104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:40.731104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:40.731104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:40.731104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:40.731104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:40.731104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:40.731104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:35:40.731104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:35:40.731104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:35:40.731104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:35:40.732329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:35:40.732329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:35:40.732329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:35:40.732329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:35:40.732329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:40.732329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:40.732329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:40.732329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:40.732329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:40.732329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:40.732329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:40.732329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:40.732329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:40.732329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:40.732329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:40.732329 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:40.733225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:40.733225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:40.733225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:40.733225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:40.733225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:35:40.733225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:35:40.733225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:35:40.733225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:35:40.733225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:35:40.733225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:35:40.733225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 20:35:40.733225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:35:40.733225 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 421/856] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Sep 24 20:35:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:40.739030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fb109-9a8a-46ce-93f1-e2829fe2786d None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:40.783912 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:40.854157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fb109-9a8a-46ce-93f1-e2829fe2786d None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:40.894440 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889345eb-9433-43a6-9f98-faa21f1cbb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:40.895155 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889345eb-9433-43a6-9f98-faa21f1cbb68 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:40.895436 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889345eb-9433-43a6-9f98-faa21f1cbb68 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:40.895707 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889345eb-9433-43a6-9f98-faa21f1cbb68 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:40.896526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889345eb-9433-43a6-9f98-faa21f1cbb68 None admin] RBAC: Adding query filter params (name=service) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:40.896833 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889345eb-9433-43a6-9f98-faa21f1cbb68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:40.898522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889345eb-9433-43a6-9f98-faa21f1cbb68 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:40.906814 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 436/857] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Sep 24 20:35:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:40.913762 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c314c-2113-4b48-a6fc-c876befb422a None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:41.005458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:41.023484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c314c-2113-4b48-a6fc-c876befb422a None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:41.065377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161e355-44c7-4486-8f49-5ac1a598ba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:41.066103 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161e355-44c7-4486-8f49-5ac1a598ba2c None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:41.066446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161e355-44c7-4486-8f49-5ac1a598ba2c None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:41.066929 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161e355-44c7-4486-8f49-5ac1a598ba2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:41.081748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161e355-44c7-4486-8f49-5ac1a598ba2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:41.083276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161e355-44c7-4486-8f49-5ac1a598ba2c None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:41.099710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-b161e355-44c7-4486-8f49-5ac1a598ba2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:41.099710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:41.099710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:41.099710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:41.099710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:41.099710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:41.099710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:41.099710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:41.099710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:41.099710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:41.099710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:41.099710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:41.099710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:35:41.099710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:35:41.099710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:35:41.099710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:41.100850 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:35:41.101963 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:35:41.101963 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:41.101963 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:35:41.101963 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 422/858] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:41.108089 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889345eb-9433-43a6-9f98-faa21f1cbb68 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:41.221834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889345eb-9433-43a6-9f98-faa21f1cbb68 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:41.224297 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:41.261947 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1c8e5-30b3-4a3b-867e-d3dc5c80e483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:41.262553 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1c8e5-30b3-4a3b-867e-d3dc5c80e483 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:41.263187 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1c8e5-30b3-4a3b-867e-d3dc5c80e483 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:41.263542 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d1c8e5-30b3-4a3b-867e-d3dc5c80e483 None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:41.264391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1c8e5-30b3-4a3b-867e-d3dc5c80e483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:41.264755 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1c8e5-30b3-4a3b-867e-d3dc5c80e483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:41.266668 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d1c8e5-30b3-4a3b-867e-d3dc5c80e483 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:41.280802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 437/859] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:41.287586 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161e355-44c7-4486-8f49-5ac1a598ba2c None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:41.408017 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161e355-44c7-4486-8f49-5ac1a598ba2c None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:41.446700 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fe322-16af-43fc-b2b5-e21310cc8068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:41.447332 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe322-16af-43fc-b2b5-e21310cc8068 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:41.447620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe322-16af-43fc-b2b5-e21310cc8068 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:41.447897 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe322-16af-43fc-b2b5-e21310cc8068 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:41.450638 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:41.457642 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fe322-16af-43fc-b2b5-e21310cc8068 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:41.459172 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fe322-16af-43fc-b2b5-e21310cc8068 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:41.472202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-4a0fe322-16af-43fc-b2b5-e21310cc8068 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 20:35:41.472202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:41.472202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:41.472202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:41.472202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:41.472202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:41.472202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:41.472202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:41.472202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:41.472202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:41.472202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:41.472202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:41.472202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:35:41.472202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:35:41.472202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:35:41.472202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:41.473469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:41.474805 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:41.474805 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:41.474805 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:35:41.474805 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:35:41.474805 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:35:41.474805 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:35:41.474805 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:35:41.474805 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:35:41.474805 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 20:35:41.474805 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:35:41.474805 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 423/860] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:41.480675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1c8e5-30b3-4a3b-867e-d3dc5c80e483 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:41.589620 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d1c8e5-30b3-4a3b-867e-d3dc5c80e483 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:41.629230 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc4fea-9bbe-4fce-8fc1-34d79eaf21fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:41.629913 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc4fea-9bbe-4fce-8fc1-34d79eaf21fe None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:41.630251 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc4fea-9bbe-4fce-8fc1-34d79eaf21fe None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:41.630555 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc4fea-9bbe-4fce-8fc1-34d79eaf21fe None admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:41.631409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc4fea-9bbe-4fce-8fc1-34d79eaf21fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:41.631740 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc4fea-9bbe-4fce-8fc1-34d79eaf21fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:41.633425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc4fea-9bbe-4fce-8fc1-34d79eaf21fe None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:41.653771 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 438/861] 10.222.0.61 () {56 vars in 1143 bytes} [Sat Sep 24 20:35:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:41.660686 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fe322-16af-43fc-b2b5-e21310cc8068 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:41.774099 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fe322-16af-43fc-b2b5-e21310cc8068 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:41.813193 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b21af-75c3-41a2-9687-fd6c3d7252c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:41.813903 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b21af-75c3-41a2-9687-fd6c3d7252c7 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:41.814912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b21af-75c3-41a2-9687-fd6c3d7252c7 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:41.815297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b21af-75c3-41a2-9687-fd6c3d7252c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:41.891285 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:41.898703 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b21af-75c3-41a2-9687-fd6c3d7252c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:41.900178 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b21af-75c3-41a2-9687-fd6c3d7252c7 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:42.009196 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 424/862] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:35:41 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 20:35:42.015555 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc4fea-9bbe-4fce-8fc1-34d79eaf21fe None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:42.129209 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc4fea-9bbe-4fce-8fc1-34d79eaf21fe None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:42.167535 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416bfe1-6f73-4946-ba6e-32982de14416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:42.168244 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416bfe1-6f73-4946-ba6e-32982de14416 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:42.168594 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416bfe1-6f73-4946-ba6e-32982de14416 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:42.168895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416bfe1-6f73-4946-ba6e-32982de14416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:42.182365 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416bfe1-6f73-4946-ba6e-32982de14416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:42.183911 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b416bfe1-6f73-4946-ba6e-32982de14416 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:42.199749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-b416bfe1-6f73-4946-ba6e-32982de14416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:42.199749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:42.199749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:42.199749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:42.199749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:42.199749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:42.199749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:42.199749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:42.199749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:42.199749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:42.199749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:42.199749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:42.199749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:35:42.199749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:35:42.199749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:35:42.199749 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:42.201151 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:35:42.202413 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:35:42.202413 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:42.202413 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:35:42.202413 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 439/863] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:42.207242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b21af-75c3-41a2-9687-fd6c3d7252c7 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:42.315052 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:42.322491 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b21af-75c3-41a2-9687-fd6c3d7252c7 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:42.360314 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf4d8b-b58a-48ea-9818-303d09523cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:42.360990 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf4d8b-b58a-48ea-9818-303d09523cbb None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:42.361370 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf4d8b-b58a-48ea-9818-303d09523cbb None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:42.361697 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf4d8b-b58a-48ea-9818-303d09523cbb None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:42.362378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf4d8b-b58a-48ea-9818-303d09523cbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:42.362726 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf4d8b-b58a-48ea-9818-303d09523cbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:42.364250 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf4d8b-b58a-48ea-9818-303d09523cbb None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:42.377393 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 425/864] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:42.383192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416bfe1-6f73-4946-ba6e-32982de14416 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:42.483746 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:42.512787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416bfe1-6f73-4946-ba6e-32982de14416 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:42.551314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04febbe3-33e9-4930-996a-102725b9a4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:42.552170 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04febbe3-33e9-4930-996a-102725b9a4ec None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:42.552524 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04febbe3-33e9-4930-996a-102725b9a4ec None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:42.552857 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04febbe3-33e9-4930-996a-102725b9a4ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:42.559828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04febbe3-33e9-4930-996a-102725b9a4ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:42.561364 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04febbe3-33e9-4930-996a-102725b9a4ec None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:42.575009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-04febbe3-33e9-4930-996a-102725b9a4ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:35:42.575009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:42.575009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:42.575009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:42.575009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:42.575009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:42.575009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:42.575009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:42.575009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:42.575009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:42.575009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:42.575009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:42.575009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:35:42.575009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:35:42.575009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:42.575991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:42.577047 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:35:42.577047 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:35:42.577047 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:35:42.577047 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:35:42.577047 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:35:42.577047 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:35:42.577047 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:35:42.577047 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:35:42.577047 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 440/865] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:35:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:42.582481 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf4d8b-b58a-48ea-9818-303d09523cbb None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:42.697264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf4d8b-b58a-48ea-9818-303d09523cbb None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:42.737184 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e6726-a109-4294-bb9a-3c7396cdbfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:42.737988 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e6726-a109-4294-bb9a-3c7396cdbfd7 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:42.738271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e6726-a109-4294-bb9a-3c7396cdbfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:42.738548 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e6726-a109-4294-bb9a-3c7396cdbfd7 None admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:42.739274 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e6726-a109-4294-bb9a-3c7396cdbfd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:42.739583 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e6726-a109-4294-bb9a-3c7396cdbfd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:42.741178 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e6726-a109-4294-bb9a-3c7396cdbfd7 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:42.757026 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 426/866] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:35:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:42.762710 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04febbe3-33e9-4930-996a-102725b9a4ec None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:42.882707 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04febbe3-33e9-4930-996a-102725b9a4ec None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:42.919822 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94d142-0b78-4c63-88fe-484e6567c26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:42.920426 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94d142-0b78-4c63-88fe-484e6567c26a None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:42.920704 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94d142-0b78-4c63-88fe-484e6567c26a None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:42.920972 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94d142-0b78-4c63-88fe-484e6567c26a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:42.921684 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94d142-0b78-4c63-88fe-484e6567c26a None admin] RBAC: Adding query filter params (role.id=6e079191d798481b811c5c8dca0c0f7a, scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341, user.id=d3060c5a247f495990fd7eec99c0ee0a) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:42.921984 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94d142-0b78-4c63-88fe-484e6567c26a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:42.923396 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94d142-0b78-4c63-88fe-484e6567c26a None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:42.925154 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:42.930328 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 441/867] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:35:42 2022] GET /identity/v3/role_assignments?user.id=d3060c5a247f495990fd7eec99c0ee0a&scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341&role.id=6e079191d798481b811c5c8dca0c0f7a => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:35:45.570647 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3ba2a-2722-4317-8df0-56fbc42468a9 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:45.571142 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3ba2a-2722-4317-8df0-56fbc42468a9 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:45.571142 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3ba2a-2722-4317-8df0-56fbc42468a9 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:45.572438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 427/868] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:35:45.577578 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3000222-3a29-44bb-a5f1-d8582f756461 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:45.577967 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3000222-3a29-44bb-a5f1-d8582f756461 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:45.578118 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3000222-3a29-44bb-a5f1-d8582f756461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:45.596911 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-f3000222-3a29-44bb-a5f1-d8582f756461 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:35:45.598065 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-f3000222-3a29-44bb-a5f1-d8582f756461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:35:45.661455 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 442/869] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:35:45 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:35:46.013013 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3ba2a-2722-4317-8df0-56fbc42468a9 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:46.031222 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:46.113346 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3ba2a-2722-4317-8df0-56fbc42468a9 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:46.145764 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81a627-b1ce-4905-96e8-d4fd313486ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:46.146376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81a627-b1ce-4905-96e8-d4fd313486ee None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:46.146659 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81a627-b1ce-4905-96e8-d4fd313486ee None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:46.146934 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81a627-b1ce-4905-96e8-d4fd313486ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:46.156974 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81a627-b1ce-4905-96e8-d4fd313486ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:35:46.162484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-6a81a627-b1ce-4905-96e8-d4fd313486ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:35:46.162484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:46.162484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:46.162484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:46.162484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:46.162484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:46.162484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:46.162484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:46.162484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:46.162484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:46.162484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:46.162484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:46.162484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:35:46.162484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:35:46.162484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:35:46.162484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:35:46.163458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:35:46.163458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:35:46.163458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:35:46.163458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:35:46.163458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:46.163458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:46.163458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:46.163458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:46.163458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:46.163458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:46.163458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:46.163458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:46.163458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:46.163458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:46.163458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:46.163458 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:46.164396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:46.164396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:46.164396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:46.164396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:46.164396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:35:46.164396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:35:46.164396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:35:46.164396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:35:46.164396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:35:46.164396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:35:46.164396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:35:46.164396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:35:46.164396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 428/870] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:35:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:46.169910 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3000222-3a29-44bb-a5f1-d8582f756461 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:46.269079 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3000222-3a29-44bb-a5f1-d8582f756461 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:46.294456 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:46.302922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1517b-46cb-48ee-8e37-efd15ffd43cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:46.303525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1517b-46cb-48ee-8e37-efd15ffd43cc None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:46.303804 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1517b-46cb-48ee-8e37-efd15ffd43cc None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:46.304076 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1517b-46cb-48ee-8e37-efd15ffd43cc None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:46.304772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1517b-46cb-48ee-8e37-efd15ffd43cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:46.305077 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1517b-46cb-48ee-8e37-efd15ffd43cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:46.306430 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1517b-46cb-48ee-8e37-efd15ffd43cc None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:46.314777 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 443/871] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:35:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:46.320771 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81a627-b1ce-4905-96e8-d4fd313486ee None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:46.395798 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:46.419004 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81a627-b1ce-4905-96e8-d4fd313486ee None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:46.451252 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40863faf-dfcb-4471-ba15-6372c5689576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:46.451870 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863faf-dfcb-4471-ba15-6372c5689576 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:46.452154 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863faf-dfcb-4471-ba15-6372c5689576 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:46.452472 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40863faf-dfcb-4471-ba15-6372c5689576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:46.462671 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40863faf-dfcb-4471-ba15-6372c5689576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:46.464110 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40863faf-dfcb-4471-ba15-6372c5689576 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:46.478202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-40863faf-dfcb-4471-ba15-6372c5689576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:46.478202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:46.478202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:46.478202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:46.478202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:46.478202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:46.478202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:46.478202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:46.478202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:46.478202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:46.478202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:46.478202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:46.478202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:35:46.478202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:35:46.478202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:35:46.478202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:46.479290 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:35:46.480519 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:35:46.480519 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:46.480519 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:35:46.480519 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 429/872] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:46.485166 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1517b-46cb-48ee-8e37-efd15ffd43cc None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:46.581273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1517b-46cb-48ee-8e37-efd15ffd43cc None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:46.614014 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ff556-58bb-40c4-ad18-e27c1814c932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:46.614614 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ff556-58bb-40c4-ad18-e27c1814c932 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:46.614898 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ff556-58bb-40c4-ad18-e27c1814c932 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:46.615176 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ff556-58bb-40c4-ad18-e27c1814c932 None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:46.615807 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ff556-58bb-40c4-ad18-e27c1814c932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:46.616116 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ff556-58bb-40c4-ad18-e27c1814c932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:46.617509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1ff556-58bb-40c4-ad18-e27c1814c932 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:46.628706 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 444/873] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:46.634224 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40863faf-dfcb-4471-ba15-6372c5689576 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:46.731173 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40863faf-dfcb-4471-ba15-6372c5689576 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:46.757067 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:46.765083 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c47fb-6992-461d-a210-cd806ef92039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:46.765697 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c47fb-6992-461d-a210-cd806ef92039 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:46.765980 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c47fb-6992-461d-a210-cd806ef92039 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:46.766256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c47fb-6992-461d-a210-cd806ef92039 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:46.773506 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c47fb-6992-461d-a210-cd806ef92039 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:46.774925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c47fb-6992-461d-a210-cd806ef92039 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:46.787380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-964c47fb-6992-461d-a210-cd806ef92039 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 20:35:46.787380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:46.787380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:46.787380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:46.787380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:46.787380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:46.787380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:46.787380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:46.787380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:46.787380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:46.787380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:46.787380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:46.787380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:35:46.787380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:35:46.787380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:35:46.787380 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:46.788618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:46.790002 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:46.790002 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:46.790002 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:35:46.790002 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:35:46.790002 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:35:46.790002 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:35:46.790002 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:35:46.790002 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:35:46.790002 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 20:35:46.790002 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:35:46.790002 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 430/874] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:46.795277 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ff556-58bb-40c4-ad18-e27c1814c932 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:46.850623 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:46.899696 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1ff556-58bb-40c4-ad18-e27c1814c932 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:46.932876 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71245c61-c16d-44cf-b432-36274c8078bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:46.933474 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71245c61-c16d-44cf-b432-36274c8078bc None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:46.933756 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71245c61-c16d-44cf-b432-36274c8078bc None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:46.934032 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71245c61-c16d-44cf-b432-36274c8078bc None admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:46.934747 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71245c61-c16d-44cf-b432-36274c8078bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:46.935054 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71245c61-c16d-44cf-b432-36274c8078bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:46.936495 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71245c61-c16d-44cf-b432-36274c8078bc None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:46.953399 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 445/875] 10.222.0.61 () {56 vars in 1143 bytes} [Sat Sep 24 20:35:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:46.959269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c47fb-6992-461d-a210-cd806ef92039 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:47.054625 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c47fb-6992-461d-a210-cd806ef92039 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:47.086635 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cf3ac-2088-4037-a1da-d830be54d4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:47.087216 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cf3ac-2088-4037-a1da-d830be54d4bd None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:47.087496 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cf3ac-2088-4037-a1da-d830be54d4bd None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:47.087771 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cf3ac-2088-4037-a1da-d830be54d4bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:47.140208 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:47.152617 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cf3ac-2088-4037-a1da-d830be54d4bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:47.154035 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cf3ac-2088-4037-a1da-d830be54d4bd None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:47.249032 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 431/876] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:35:46 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 20:35:47.255087 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71245c61-c16d-44cf-b432-36274c8078bc None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:47.352365 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71245c61-c16d-44cf-b432-36274c8078bc None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:47.361988 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:47.386562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87608186-ea95-4658-8b38-639ded3fe906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:47.387180 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87608186-ea95-4658-8b38-639ded3fe906 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:47.387462 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87608186-ea95-4658-8b38-639ded3fe906 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:47.387736 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87608186-ea95-4658-8b38-639ded3fe906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:47.397654 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87608186-ea95-4658-8b38-639ded3fe906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:47.399028 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87608186-ea95-4658-8b38-639ded3fe906 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:47.413669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-87608186-ea95-4658-8b38-639ded3fe906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:47.413669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:47.413669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:47.413669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:47.413669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:47.413669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:47.413669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:47.413669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:47.413669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:47.413669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:47.413669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:47.413669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:47.413669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:35:47.413669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:35:47.413669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:35:47.413669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:47.415007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:35:47.415996 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:35:47.415996 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:47.415996 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:35:47.415996 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 446/877] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:47.420937 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cf3ac-2088-4037-a1da-d830be54d4bd None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:47.508107 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:47.521345 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cf3ac-2088-4037-a1da-d830be54d4bd None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:47.555037 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e45d4-b45d-4bd2-b820-cc79d8ec09fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:47.555635 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e45d4-b45d-4bd2-b820-cc79d8ec09fd None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:47.555916 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e45d4-b45d-4bd2-b820-cc79d8ec09fd None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:47.556191 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e45d4-b45d-4bd2-b820-cc79d8ec09fd None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:47.556855 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e45d4-b45d-4bd2-b820-cc79d8ec09fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:47.557161 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e45d4-b45d-4bd2-b820-cc79d8ec09fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:47.558525 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e45d4-b45d-4bd2-b820-cc79d8ec09fd None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:47.569864 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 432/878] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:47.575519 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87608186-ea95-4658-8b38-639ded3fe906 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:47.673132 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87608186-ea95-4658-8b38-639ded3fe906 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:47.705443 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e452a-a387-4ed4-b834-445cd42ce323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:47.706064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e452a-a387-4ed4-b834-445cd42ce323 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:47.706344 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e452a-a387-4ed4-b834-445cd42ce323 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:47.706618 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e452a-a387-4ed4-b834-445cd42ce323 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:47.714002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e452a-a387-4ed4-b834-445cd42ce323 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:47.715441 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48e452a-a387-4ed4-b834-445cd42ce323 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:47.727112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-c48e452a-a387-4ed4-b834-445cd42ce323 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:35:47.727112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:47.727112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:47.727112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:47.727112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:47.727112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:47.727112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:47.727112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:47.727112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:47.727112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:47.727112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:47.727112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:47.727112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:35:47.727112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:35:47.727112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:47.728143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:47.729117 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:35:47.729117 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:35:47.729117 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:35:47.729117 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:35:47.729117 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:35:47.729117 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:35:47.729117 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:35:47.729117 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:35:47.729117 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 447/879] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:35:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:47.734063 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e45d4-b45d-4bd2-b820-cc79d8ec09fd None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:47.837879 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e45d4-b45d-4bd2-b820-cc79d8ec09fd None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:47.869844 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf3266-2b42-4bb5-a698-d617cb17d594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:47.870375 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf3266-2b42-4bb5-a698-d617cb17d594 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:47.870653 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf3266-2b42-4bb5-a698-d617cb17d594 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:47.870927 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf3266-2b42-4bb5-a698-d617cb17d594 None admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:47.871602 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf3266-2b42-4bb5-a698-d617cb17d594 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:47.871906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf3266-2b42-4bb5-a698-d617cb17d594 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:47.873363 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf3266-2b42-4bb5-a698-d617cb17d594 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:47.885195 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 433/880] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:35:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:47.891248 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e452a-a387-4ed4-b834-445cd42ce323 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:47.913416 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:47.988774 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e452a-a387-4ed4-b834-445cd42ce323 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:48.021476 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf04649-3314-4918-8359-5575fdc9861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:48.022064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf04649-3314-4918-8359-5575fdc9861b None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:48.022344 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf04649-3314-4918-8359-5575fdc9861b None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:48.022617 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf04649-3314-4918-8359-5575fdc9861b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:48.023335 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf04649-3314-4918-8359-5575fdc9861b None admin] RBAC: Adding query filter params (role.id=9cc90aa0ccde4b75b7642101cbf45cf2, scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341, user.id=d3060c5a247f495990fd7eec99c0ee0a) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:48.023645 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf04649-3314-4918-8359-5575fdc9861b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:48.025080 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf04649-3314-4918-8359-5575fdc9861b None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:48.030288 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 448/881] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:35:47 2022] GET /identity/v3/role_assignments?user.id=d3060c5a247f495990fd7eec99c0ee0a&scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341&role.id=9cc90aa0ccde4b75b7642101cbf45cf2 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:50.416041 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99bcb4-4b6a-4fe5-8608-7c904242fa70 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:50.416577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99bcb4-4b6a-4fe5-8608-7c904242fa70 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:50.416577 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99bcb4-4b6a-4fe5-8608-7c904242fa70 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:50.417843 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 434/882] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:35:50.422963 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d36d5-f698-4082-a77f-1e830e9d8100 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:50.423972 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d36d5-f698-4082-a77f-1e830e9d8100 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:50.424103 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d36d5-f698-4082-a77f-1e830e9d8100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:50.446243 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-9a1d36d5-f698-4082-a77f-1e830e9d8100 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:35:50.447432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-9a1d36d5-f698-4082-a77f-1e830e9d8100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:35:50.512204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 449/883] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:35:50 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:35:50.832967 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99bcb4-4b6a-4fe5-8608-7c904242fa70 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:50.843642 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:50.933847 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99bcb4-4b6a-4fe5-8608-7c904242fa70 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:50.965379 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2073d7-6830-4974-a1a6-155be44e7dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:50.965992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2073d7-6830-4974-a1a6-155be44e7dbf None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:50.966269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2073d7-6830-4974-a1a6-155be44e7dbf None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:50.966542 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2073d7-6830-4974-a1a6-155be44e7dbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:50.976622 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2073d7-6830-4974-a1a6-155be44e7dbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:35:50.981281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-3b2073d7-6830-4974-a1a6-155be44e7dbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:35:50.981281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:50.981281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:50.981281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:50.981281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:50.981281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:50.981281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:50.981281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:50.981281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:50.981281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:50.981281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:50.981281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:50.981281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:35:50.981281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:35:50.981281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:35:50.981281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:35:50.982338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:35:50.982338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:35:50.982338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:35:50.982338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:35:50.982338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:50.982338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:50.982338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:50.982338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:50.982338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:50.982338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:50.982338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:50.982338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:50.982338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:50.982338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:50.982338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:50.982338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:50.983194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:50.983194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:50.983194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:50.983194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:50.983194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:35:50.983194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:35:50.983194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:35:50.983194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:35:50.983194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:35:50.983194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:35:50.983194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:35:50.983194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:35:50.983194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 435/884] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:35:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:50.989179 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d36d5-f698-4082-a77f-1e830e9d8100 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:51.003710 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:51.084410 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d36d5-f698-4082-a77f-1e830e9d8100 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:51.117221 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584c226-ee7f-4dbd-8fa8-67e91c5e31f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:51.117812 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584c226-ee7f-4dbd-8fa8-67e91c5e31f5 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:51.118090 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584c226-ee7f-4dbd-8fa8-67e91c5e31f5 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:51.118363 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584c226-ee7f-4dbd-8fa8-67e91c5e31f5 None admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:51.119015 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584c226-ee7f-4dbd-8fa8-67e91c5e31f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:51.119318 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584c226-ee7f-4dbd-8fa8-67e91c5e31f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:51.120707 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584c226-ee7f-4dbd-8fa8-67e91c5e31f5 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:51.128329 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 450/885] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:35:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:51.134032 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2073d7-6830-4974-a1a6-155be44e7dbf None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:51.198874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:51.232891 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2073d7-6830-4974-a1a6-155be44e7dbf None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:51.264855 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b2cae-d768-47a9-a271-4c2b8e5310b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:51.265471 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b2cae-d768-47a9-a271-4c2b8e5310b4 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:51.265753 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b2cae-d768-47a9-a271-4c2b8e5310b4 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:51.266026 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b2cae-d768-47a9-a271-4c2b8e5310b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:51.276138 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b2cae-d768-47a9-a271-4c2b8e5310b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:51.277585 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b2cae-d768-47a9-a271-4c2b8e5310b4 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:51.291881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-de1b2cae-d768-47a9-a271-4c2b8e5310b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:51.291881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:51.291881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:51.291881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:51.291881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:51.291881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:51.291881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:51.291881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:51.291881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:51.291881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:51.291881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:51.291881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:51.291881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:35:51.291881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:35:51.291881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:35:51.291881 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:51.293064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:35:51.293942 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:35:51.293942 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:51.293942 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:35:51.293942 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 436/886] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:51.299303 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584c226-ee7f-4dbd-8fa8-67e91c5e31f5 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:51.373305 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:51.396503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584c226-ee7f-4dbd-8fa8-67e91c5e31f5 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:51.430263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15c07d-0836-4ae9-adc3-0be3b5b99b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:51.430861 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15c07d-0836-4ae9-adc3-0be3b5b99b0e None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:51.431129 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15c07d-0836-4ae9-adc3-0be3b5b99b0e None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:51.431401 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15c07d-0836-4ae9-adc3-0be3b5b99b0e None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:51.432032 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15c07d-0836-4ae9-adc3-0be3b5b99b0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:51.432356 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15c07d-0836-4ae9-adc3-0be3b5b99b0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:51.433725 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15c07d-0836-4ae9-adc3-0be3b5b99b0e None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:51.445699 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 451/887] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:51.451382 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b2cae-d768-47a9-a271-4c2b8e5310b4 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:51.547990 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b2cae-d768-47a9-a271-4c2b8e5310b4 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:51.567106 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:51.581429 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d204a-4b2c-443d-abb4-bc0d92eb0068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:51.582135 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d204a-4b2c-443d-abb4-bc0d92eb0068 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:51.582417 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d204a-4b2c-443d-abb4-bc0d92eb0068 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:51.582695 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d204a-4b2c-443d-abb4-bc0d92eb0068 None admin] PATH_INFO: `/v3/users/placement` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:51.591351 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d204a-4b2c-443d-abb4-bc0d92eb0068 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:51.592812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d204a-4b2c-443d-abb4-bc0d92eb0068 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:51.604484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-dc2d204a-4b2c-443d-abb4-bc0d92eb0068 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 20:35:51.604484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:51.604484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:51.604484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:51.604484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:51.604484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:51.604484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:51.604484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:51.604484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:51.604484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:51.604484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:51.604484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:51.604484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:35:51.604484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:35:51.604484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:35:51.604484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:51.605579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:51.606509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:51.606509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:51.606509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:35:51.606509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:35:51.606509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:35:51.606509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:35:51.606509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:35:51.606509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:35:51.606509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 20:35:51.606509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:35:51.606509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 437/888] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:51.611536 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15c07d-0836-4ae9-adc3-0be3b5b99b0e None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:51.706954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15c07d-0836-4ae9-adc3-0be3b5b99b0e None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:51.739254 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d13d0-31ea-444c-b5b1-06a5eb161656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:51.739839 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d13d0-31ea-444c-b5b1-06a5eb161656 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:51.740114 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d13d0-31ea-444c-b5b1-06a5eb161656 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:51.740409 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d13d0-31ea-444c-b5b1-06a5eb161656 None admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:51.741117 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d13d0-31ea-444c-b5b1-06a5eb161656 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:51.741418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d13d0-31ea-444c-b5b1-06a5eb161656 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:51.742815 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d13d0-31ea-444c-b5b1-06a5eb161656 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:51.745224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:51.760643 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 452/889] 10.222.0.61 () {56 vars in 1143 bytes} [Sat Sep 24 20:35:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:51.766474 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d204a-4b2c-443d-abb4-bc0d92eb0068 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:51.872253 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d204a-4b2c-443d-abb4-bc0d92eb0068 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:51.906983 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea725c24-7950-4939-bcbb-77f6da357be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:51.907595 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea725c24-7950-4939-bcbb-77f6da357be0 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:51.907872 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea725c24-7950-4939-bcbb-77f6da357be0 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:51.908150 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea725c24-7950-4939-bcbb-77f6da357be0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:51.918376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea725c24-7950-4939-bcbb-77f6da357be0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:51.919790 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea725c24-7950-4939-bcbb-77f6da357be0 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:51.933266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-ea725c24-7950-4939-bcbb-77f6da357be0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:51.933266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:51.933266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:51.933266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:51.933266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:51.933266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:51.933266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:51.933266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:51.933266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:51.933266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:51.933266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:51.933266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:51.933266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:35:51.933266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:35:51.933266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:35:51.933266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:51.939294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:35:51.940418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:35:51.940418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:51.940418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:35:51.940418 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 438/890] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:51.940823 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d13d0-31ea-444c-b5b1-06a5eb161656 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:52.036937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d13d0-31ea-444c-b5b1-06a5eb161656 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:52.070349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86f18d-d07c-49c3-9478-f2303139f471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:52.070943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86f18d-d07c-49c3-9478-f2303139f471 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:52.071225 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86f18d-d07c-49c3-9478-f2303139f471 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:52.071498 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86f18d-d07c-49c3-9478-f2303139f471 None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:52.072128 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86f18d-d07c-49c3-9478-f2303139f471 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:52.072459 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86f18d-d07c-49c3-9478-f2303139f471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:52.073816 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86f18d-d07c-49c3-9478-f2303139f471 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:52.084591 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 453/891] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:52.090164 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea725c24-7950-4939-bcbb-77f6da357be0 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:52.120867 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:52.188223 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea725c24-7950-4939-bcbb-77f6da357be0 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:52.220376 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53954560-714c-46d7-ad3b-c28ae05131b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:52.220991 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53954560-714c-46d7-ad3b-c28ae05131b8 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:52.221269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53954560-714c-46d7-ad3b-c28ae05131b8 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:52.221537 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53954560-714c-46d7-ad3b-c28ae05131b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:52.227928 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53954560-714c-46d7-ad3b-c28ae05131b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:52.229392 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53954560-714c-46d7-ad3b-c28ae05131b8 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:52.240747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-53954560-714c-46d7-ad3b-c28ae05131b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:35:52.240747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:52.240747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:52.240747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:52.240747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:52.240747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:52.240747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:52.240747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:52.240747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:52.240747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:52.240747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:52.240747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:52.240747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:35:52.240747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:35:52.240747 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:52.241765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:52.243032 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:35:52.243032 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:35:52.243032 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:35:52.243032 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:35:52.243032 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:35:52.243032 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:35:52.243032 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:35:52.243032 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:35:52.243032 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 439/892] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:35:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:52.247554 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86f18d-d07c-49c3-9478-f2303139f471 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:52.301486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:52.345797 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86f18d-d07c-49c3-9478-f2303139f471 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:52.378072 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef40130-345e-4d71-83ec-13fe41502c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:52.378664 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef40130-345e-4d71-83ec-13fe41502c5a None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:52.378946 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef40130-345e-4d71-83ec-13fe41502c5a None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:52.379220 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef40130-345e-4d71-83ec-13fe41502c5a None admin] PATH_INFO: `/v3/projects` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:52.379894 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef40130-345e-4d71-83ec-13fe41502c5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:52.380204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef40130-345e-4d71-83ec-13fe41502c5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:52.381644 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef40130-345e-4d71-83ec-13fe41502c5a None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:52.393098 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 454/893] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:35:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:52.398922 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53954560-714c-46d7-ad3b-c28ae05131b8 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:52.486499 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:52.495514 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53954560-714c-46d7-ad3b-c28ae05131b8 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:52.528215 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044931c9-9578-4cae-8742-f85fdf376389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:52.528896 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044931c9-9578-4cae-8742-f85fdf376389 None admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:52.529177 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044931c9-9578-4cae-8742-f85fdf376389 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:52.529450 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044931c9-9578-4cae-8742-f85fdf376389 None admin] PATH_INFO: `/v3/projects/6e446dc5c12d49bca59e6e8c8ad90341/users/d3060c5a247f495990fd7eec99c0ee0a/roles/9cc90aa0ccde4b75b7642101cbf45cf2` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:52.531339 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044931c9-9578-4cae-8742-f85fdf376389 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e446dc5c12d49bca59e6e8c8ad90341, user_id=d3060c5a247f495990fd7eec99c0ee0a, role_id=9cc90aa0ccde4b75b7642101cbf45cf2)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:52.533338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044931c9-9578-4cae-8742-f85fdf376389 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:52.545381 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 440/894] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Sep 24 20:35:52 2022] PUT /identity/v3/projects/6e446dc5c12d49bca59e6e8c8ad90341/users/d3060c5a247f495990fd7eec99c0ee0a/roles/9cc90aa0ccde4b75b7642101cbf45cf2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:35:54.930132 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184006b4-7e0c-4fb6-bda4-c8a1e363a29a None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:54.930819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184006b4-7e0c-4fb6-bda4-c8a1e363a29a None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:54.930819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184006b4-7e0c-4fb6-bda4-c8a1e363a29a None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:54.932005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 455/895] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:35:54.937296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dba312-3f34-44ad-9bef-abcdb6c0133a None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:54.937673 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dba312-3f34-44ad-9bef-abcdb6c0133a None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:54.937857 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dba312-3f34-44ad-9bef-abcdb6c0133a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:54.955719 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-65dba312-3f34-44ad-9bef-abcdb6c0133a None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:35:54.956946 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-65dba312-3f34-44ad-9bef-abcdb6c0133a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:35:55.021737 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 441/896] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:35:54 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:35:55.342845 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184006b4-7e0c-4fb6-bda4-c8a1e363a29a None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:55.444012 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184006b4-7e0c-4fb6-bda4-c8a1e363a29a None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:55.461416 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:55.481796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd368d-5d74-496b-af8b-2aca8fb59dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:55.482419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd368d-5d74-496b-af8b-2aca8fb59dd1 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:55.482698 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd368d-5d74-496b-af8b-2aca8fb59dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:55.482967 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd368d-5d74-496b-af8b-2aca8fb59dd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:55.493663 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd368d-5d74-496b-af8b-2aca8fb59dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 20:35:55.498403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-6dfd368d-5d74-496b-af8b-2aca8fb59dd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:35:55.498403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:55.498403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:55.498403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:55.498403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:55.498403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:55.498403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:55.498403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:55.498403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:55.498403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:55.498403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:55.498403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:55.498403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 20:35:55.498403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 20:35:55.498403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 20:35:55.498403 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 20:35:55.499503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 20:35:55.499503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 20:35:55.499503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 20:35:55.499503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 20:35:55.499503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:55.499503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:55.499503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:55.499503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:55.499503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:55.499503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:55.499503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:55.499503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:55.499503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:55.499503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:55.499503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:55.499503 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:55.500512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:55.500512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:55.500512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:55.500512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:55.500512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 20:35:55.500512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 20:35:55.500512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 20:35:55.500512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 20:35:55.500512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 20:35:55.500512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 20:35:55.500512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 20:35:55.500512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:35:55.500512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 456/897] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Sep 24 20:35:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:55.505681 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dba312-3f34-44ad-9bef-abcdb6c0133a None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:55.584091 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:55.602891 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dba312-3f34-44ad-9bef-abcdb6c0133a None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:55.636125 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ced63-38d4-4bfd-a0c2-bbd06dfe30a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:55.636759 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ced63-38d4-4bfd-a0c2-bbd06dfe30a5 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:55.637043 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ced63-38d4-4bfd-a0c2-bbd06dfe30a5 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:55.637317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ced63-38d4-4bfd-a0c2-bbd06dfe30a5 None admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:55.637968 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ced63-38d4-4bfd-a0c2-bbd06dfe30a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:55.638270 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ced63-38d4-4bfd-a0c2-bbd06dfe30a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:55.639625 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ced63-38d4-4bfd-a0c2-bbd06dfe30a5 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:55.647334 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 442/898] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Sep 24 20:35:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:55.653236 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd368d-5d74-496b-af8b-2aca8fb59dd1 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:55.749341 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd368d-5d74-496b-af8b-2aca8fb59dd1 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:55.783758 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81969893-9b53-4e42-ac2a-cdeccdaf55e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:55.784534 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81969893-9b53-4e42-ac2a-cdeccdaf55e0 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:55.784813 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81969893-9b53-4e42-ac2a-cdeccdaf55e0 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:55.785091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81969893-9b53-4e42-ac2a-cdeccdaf55e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:55.796755 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81969893-9b53-4e42-ac2a-cdeccdaf55e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:55.798429 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81969893-9b53-4e42-ac2a-cdeccdaf55e0 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:55.816973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-81969893-9b53-4e42-ac2a-cdeccdaf55e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:55.816973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:55.816973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:55.816973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:55.816973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:55.816973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:55.816973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:55.816973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:55.816973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:55.816973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:55.816973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:55.816973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:55.816973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:35:55.816973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:35:55.816973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:35:55.816973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:55.818451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:35:55.820157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:35:55.820157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:55.820157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:35:55.820157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 457/899] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:55.825317 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ced63-38d4-4bfd-a0c2-bbd06dfe30a5 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:55.939052 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ced63-38d4-4bfd-a0c2-bbd06dfe30a5 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:55.973488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0de4e-396d-4610-8fde-bea44bd3f1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:55.974087 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0de4e-396d-4610-8fde-bea44bd3f1d5 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:55.974367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0de4e-396d-4610-8fde-bea44bd3f1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:55.974643 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0de4e-396d-4610-8fde-bea44bd3f1d5 None admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:55.975269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0de4e-396d-4610-8fde-bea44bd3f1d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:55.975573 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0de4e-396d-4610-8fde-bea44bd3f1d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:55.976952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0de4e-396d-4610-8fde-bea44bd3f1d5 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:55.988179 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 443/900] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:55.993883 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81969893-9b53-4e42-ac2a-cdeccdaf55e0 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:56.021377 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:56.092357 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81969893-9b53-4e42-ac2a-cdeccdaf55e0 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:56.125154 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e651b-d387-4e71-a04f-f354e6ae69df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:56.125792 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e651b-d387-4e71-a04f-f354e6ae69df None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:56.126568 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e651b-d387-4e71-a04f-f354e6ae69df None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:56.126841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e651b-d387-4e71-a04f-f354e6ae69df None admin] PATH_INFO: `/v3/users/placement` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:56.134005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e651b-d387-4e71-a04f-f354e6ae69df None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:56.135431 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e651b-d387-4e71-a04f-f354e6ae69df None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:56.146999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-163e651b-d387-4e71-a04f-f354e6ae69df None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 20:35:56.146999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:56.146999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:56.146999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:56.146999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:56.146999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:56.146999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:56.146999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:56.146999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:56.146999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:56.146999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:56.146999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:56.146999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 20:35:56.146999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 20:35:56.146999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 20:35:56.146999 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:56.147934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:56.148973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:56.148973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:56.148973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 20:35:56.148973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 20:35:56.148973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 20:35:56.148973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 20:35:56.148973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 20:35:56.148973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 20:35:56.148973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 20:35:56.148973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:35:56.148973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 458/901] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:56.153822 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0de4e-396d-4610-8fde-bea44bd3f1d5 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:56.157876 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:56.251923 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0de4e-396d-4610-8fde-bea44bd3f1d5 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:56.284812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78f7bd-ea51-429c-8b6d-5d3c9234219a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:56.285403 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78f7bd-ea51-429c-8b6d-5d3c9234219a None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:56.285682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78f7bd-ea51-429c-8b6d-5d3c9234219a None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:56.285957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78f7bd-ea51-429c-8b6d-5d3c9234219a None admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:56.286663 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78f7bd-ea51-429c-8b6d-5d3c9234219a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:56.286965 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78f7bd-ea51-429c-8b6d-5d3c9234219a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:56.288394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78f7bd-ea51-429c-8b6d-5d3c9234219a None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:56.304955 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 444/902] 10.222.0.61 () {56 vars in 1143 bytes} [Sat Sep 24 20:35:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:56.310672 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e651b-d387-4e71-a04f-f354e6ae69df None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:56.393940 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:56.408980 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e651b-d387-4e71-a04f-f354e6ae69df None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:56.441511 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef87d0-0a9f-4df8-bc1d-d8331ec022b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:56.442107 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef87d0-0a9f-4df8-bc1d-d8331ec022b4 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:56.442388 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef87d0-0a9f-4df8-bc1d-d8331ec022b4 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:56.442663 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef87d0-0a9f-4df8-bc1d-d8331ec022b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:56.506978 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef87d0-0a9f-4df8-bc1d-d8331ec022b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:56.508374 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef87d0-0a9f-4df8-bc1d-d8331ec022b4 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:56.589228 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:56.605091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 459/903] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Sep 24 20:35:56 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 20:35:56.610929 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78f7bd-ea51-429c-8b6d-5d3c9234219a None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:56.669762 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:56.706492 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78f7bd-ea51-429c-8b6d-5d3c9234219a None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:56.738816 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051c826-3de2-45f8-bf9e-9d12f5d7c3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:56.739427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051c826-3de2-45f8-bf9e-9d12f5d7c3b6 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:56.739707 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051c826-3de2-45f8-bf9e-9d12f5d7c3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:56.739983 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051c826-3de2-45f8-bf9e-9d12f5d7c3b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:56.749602 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051c826-3de2-45f8-bf9e-9d12f5d7c3b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:56.751160 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051c826-3de2-45f8-bf9e-9d12f5d7c3b6 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:56.765256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-3051c826-3de2-45f8-bf9e-9d12f5d7c3b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:56.765256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:56.765256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:56.765256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:56.765256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:56.765256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:56.765256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:56.765256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:56.765256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:56.765256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:56.765256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:56.765256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:56.765256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 20:35:56.765256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 20:35:56.765256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 20:35:56.765256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:56.766338 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 20:35:56.768106 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 20:35:56.768106 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 20:35:56.768106 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:35:56.768106 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 445/904] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:56.772654 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef87d0-0a9f-4df8-bc1d-d8331ec022b4 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:56.869175 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef87d0-0a9f-4df8-bc1d-d8331ec022b4 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:56.902392 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d2416-52a2-45c0-9e7f-a0a035f8e6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:56.902980 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2416-52a2-45c0-9e7f-a0a035f8e6ce None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:56.903255 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2416-52a2-45c0-9e7f-a0a035f8e6ce None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:56.903523 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d2416-52a2-45c0-9e7f-a0a035f8e6ce None admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:56.904146 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d2416-52a2-45c0-9e7f-a0a035f8e6ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:56.904484 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d2416-52a2-45c0-9e7f-a0a035f8e6ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:56.905832 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d2416-52a2-45c0-9e7f-a0a035f8e6ce None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:56.916805 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 460/905] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Sep 24 20:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:56.922427 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051c826-3de2-45f8-bf9e-9d12f5d7c3b6 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:57.022097 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051c826-3de2-45f8-bf9e-9d12f5d7c3b6 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:57.034991 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:57.054656 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bb647-80c2-4bdb-85c2-ad0aa10e164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:57.055275 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bb647-80c2-4bdb-85c2-ad0aa10e164e None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:57.055554 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bb647-80c2-4bdb-85c2-ad0aa10e164e None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:57.055828 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bb647-80c2-4bdb-85c2-ad0aa10e164e None admin] PATH_INFO: `/v3/projects/service` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:57.062227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bb647-80c2-4bdb-85c2-ad0aa10e164e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:57.064188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bb647-80c2-4bdb-85c2-ad0aa10e164e None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:57.075957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application [None req-164bb647-80c2-4bdb-85c2-ad0aa10e164e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:35:57.075957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:35:57.075957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:35:57.075957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:35:57.075957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:35:57.075957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:35:57.075957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:35:57.075957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:35:57.075957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:35:57.075957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:35:57.075957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:35:57.075957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:35:57.075957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 20:35:57.075957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 20:35:57.075957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application with Lock( Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:35:57.077020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:35:57.078191 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 20:35:57.078191 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 20:35:57.078191 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 20:35:57.078191 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 20:35:57.078191 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 20:35:57.078191 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 20:35:57.078191 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 20:35:57.078191 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: ERROR keystone.server.flask.application Sep 24 20:35:57.078191 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 446/906] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Sep 24 20:35:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:35:57.083708 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d2416-52a2-45c0-9e7f-a0a035f8e6ce None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:57.128890 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:57.182852 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d2416-52a2-45c0-9e7f-a0a035f8e6ce None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:57.215525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f4854-8ab8-4aa1-9e30-24a146635c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:57.216125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f4854-8ab8-4aa1-9e30-24a146635c83 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:57.216439 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f4854-8ab8-4aa1-9e30-24a146635c83 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:57.216714 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f4854-8ab8-4aa1-9e30-24a146635c83 None admin] PATH_INFO: `/v3/projects` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:57.217387 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f4854-8ab8-4aa1-9e30-24a146635c83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:57.217690 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f4854-8ab8-4aa1-9e30-24a146635c83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:57.219098 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f4854-8ab8-4aa1-9e30-24a146635c83 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:57.230486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 461/907] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Sep 24 20:35:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:57.237310 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bb647-80c2-4bdb-85c2-ad0aa10e164e None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:35:57.345404 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bb647-80c2-4bdb-85c2-ad0aa10e164e None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:35:57.378668 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f701a-0e0d-4d10-a9c1-bfa3dfb7e344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:35:57.379304 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f701a-0e0d-4d10-a9c1-bfa3dfb7e344 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:57.379608 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f701a-0e0d-4d10-a9c1-bfa3dfb7e344 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:57.379924 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f701a-0e0d-4d10-a9c1-bfa3dfb7e344 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:57.380752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f701a-0e0d-4d10-a9c1-bfa3dfb7e344 None admin] RBAC: Adding query filter params (role.id=9cc90aa0ccde4b75b7642101cbf45cf2, scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341, user.id=d3060c5a247f495990fd7eec99c0ee0a) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:35:57.381086 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f701a-0e0d-4d10-a9c1-bfa3dfb7e344 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:35:57.382497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f701a-0e0d-4d10-a9c1-bfa3dfb7e344 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:35:57.388198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 447/908] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Sep 24 20:35:57 2022] GET /identity/v3/role_assignments?user.id=d3060c5a247f495990fd7eec99c0ee0a&scope.project.id=6e446dc5c12d49bca59e6e8c8ad90341&role.id=9cc90aa0ccde4b75b7642101cbf45cf2 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:35:59.792773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe209233-0e11-4501-b9db-7533429d1690 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:59.793426 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe209233-0e11-4501-b9db-7533429d1690 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:59.793523 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe209233-0e11-4501-b9db-7533429d1690 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:59.795115 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 462/909] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:35:59.801373 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1afbc-8fb7-499a-905f-66d2ddc8c807 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:35:59.801784 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1afbc-8fb7-499a-905f-66d2ddc8c807 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:35:59.801970 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1afbc-8fb7-499a-905f-66d2ddc8c807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:35:59.824875 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-89e1afbc-8fb7-499a-905f-66d2ddc8c807 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:35:59.826202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-89e1afbc-8fb7-499a-905f-66d2ddc8c807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:35:59.866699 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:35:59.904543 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 448/910] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:35:59 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:36:00.229427 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe209233-0e11-4501-b9db-7533429d1690 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:36:00.331498 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe209233-0e11-4501-b9db-7533429d1690 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:36:00.338778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:36:00.365856 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7ca98-0f0a-4961-8619-d5880be985b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:36:00.366477 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7ca98-0f0a-4961-8619-d5880be985b6 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:00.366759 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7ca98-0f0a-4961-8619-d5880be985b6 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:00.367036 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7ca98-0f0a-4961-8619-d5880be985b6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:00.367610 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7ca98-0f0a-4961-8619-d5880be985b6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:36:00.369027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7ca98-0f0a-4961-8619-d5880be985b6 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-c2b7ca98-0f0a-4961-8619-d5880be985b6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:36:00.378188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:36:00.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:36:00.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:36:00.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:36:00.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:36:00.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:36:00.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:36:00.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:36:00.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:36:00.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:36:00.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:36:00.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:36:00.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:36:00.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:36:00.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:36:00.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:36:00.379419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:36:00.380526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:36:00.380526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:36:00.380526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:36:00.380526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:36:00.380526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:36:00.380526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:36:00.380526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:36:00.380526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:36:00.380526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:36:00.380526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:36:00.380526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:36:00.380526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:36:00.380526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 20:36:00.380526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:36:00.380526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 463/911] 10.222.0.61 () {56 vars in 1117 bytes} [Sat Sep 24 20:36:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:36:00.385435 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1afbc-8fb7-499a-905f-66d2ddc8c807 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:36:00.479540 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1afbc-8fb7-499a-905f-66d2ddc8c807 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:36:00.513203 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c2424-2b9f-43e1-8310-b1d18c9ab294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:36:00.513813 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c2424-2b9f-43e1-8310-b1d18c9ab294 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:00.514090 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c2424-2b9f-43e1-8310-b1d18c9ab294 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:00.514361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c2424-2b9f-43e1-8310-b1d18c9ab294 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:00.514997 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c2424-2b9f-43e1-8310-b1d18c9ab294 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:36:00.515299 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c2424-2b9f-43e1-8310-b1d18c9ab294 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:36:00.516710 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c2424-2b9f-43e1-8310-b1d18c9ab294 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:36:00.522040 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 449/912] 10.222.0.61 () {56 vars in 1116 bytes} [Sat Sep 24 20:36:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:36:00.528980 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7ca98-0f0a-4961-8619-d5880be985b6 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:36:00.626335 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7ca98-0f0a-4961-8619-d5880be985b6 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:36:00.658163 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160e77d-d96e-4ccc-b9b1-a37b8b3adecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:36:00.658753 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160e77d-d96e-4ccc-b9b1-a37b8b3adecf None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:00.659030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160e77d-d96e-4ccc-b9b1-a37b8b3adecf None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:00.659300 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160e77d-d96e-4ccc-b9b1-a37b8b3adecf None admin] PATH_INFO: `/v3/services` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:00.659912 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160e77d-d96e-4ccc-b9b1-a37b8b3adecf None admin] RBAC: Adding query filter params (type=placement) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:36:00.660216 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160e77d-d96e-4ccc-b9b1-a37b8b3adecf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:36:00.661598 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160e77d-d96e-4ccc-b9b1-a37b8b3adecf None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:36:00.666201 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 464/913] 10.222.0.61 () {56 vars in 1116 bytes} [Sat Sep 24 20:36:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:36:03.044326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd19c2-0806-4f41-9811-c82ac11abd68 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:03.044929 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd19c2-0806-4f41-9811-c82ac11abd68 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:03.044929 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd19c2-0806-4f41-9811-c82ac11abd68 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:03.046220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 450/914] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:36:03.053725 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e764cb-e9d7-4efe-b5ec-3adece678578 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:03.054165 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e764cb-e9d7-4efe-b5ec-3adece678578 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:03.054261 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e764cb-e9d7-4efe-b5ec-3adece678578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:03.071884 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-33e764cb-e9d7-4efe-b5ec-3adece678578 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:36:03.073084 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-33e764cb-e9d7-4efe-b5ec-3adece678578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:36:03.098966 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:36:03.138332 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 465/915] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:36:03 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:36:03.456793 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd19c2-0806-4f41-9811-c82ac11abd68 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:36:03.487433 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:36:03.559668 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd19c2-0806-4f41-9811-c82ac11abd68 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:36:03.592039 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b60b4c-d100-4ca2-83ca-da30182e2a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:36:03.592682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b60b4c-d100-4ca2-83ca-da30182e2a3e None admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:03.592961 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b60b4c-d100-4ca2-83ca-da30182e2a3e None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:03.593287 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b60b4c-d100-4ca2-83ca-da30182e2a3e None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:03.593934 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b60b4c-d100-4ca2-83ca-da30182e2a3e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:36:03.595916 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b60b4c-d100-4ca2-83ca-da30182e2a3e None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:36:03.610094 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 451/916] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Sep 24 20:36:03 2022] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:36:05.989832 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1731044-83fb-4059-b359-264fc3af0574 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:05.990383 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1731044-83fb-4059-b359-264fc3af0574 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:05.990383 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1731044-83fb-4059-b359-264fc3af0574 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:05.991828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 466/917] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:36:05.997008 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073e16b-d1d8-41fe-aab9-cf5b5f25553f None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:05.997399 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073e16b-d1d8-41fe-aab9-cf5b5f25553f None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:05.997568 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073e16b-d1d8-41fe-aab9-cf5b5f25553f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:06.017885 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-3073e16b-d1d8-41fe-aab9-cf5b5f25553f None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:36:06.019062 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-3073e16b-d1d8-41fe-aab9-cf5b5f25553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:36:06.088270 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 452/918] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:36:05 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:36:06.407979 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1731044-83fb-4059-b359-264fc3af0574 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:36:06.504033 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1731044-83fb-4059-b359-264fc3af0574 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:36:06.536105 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a7ecf-5e9f-424e-a647-a89745cb5dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:36:06.536734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a7ecf-5e9f-424e-a647-a89745cb5dfe None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:06.537011 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a7ecf-5e9f-424e-a647-a89745cb5dfe None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:06.537279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a7ecf-5e9f-424e-a647-a89745cb5dfe None admin] PATH_INFO: `/v3/services/placement` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:06.537842 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a7ecf-5e9f-424e-a647-a89745cb5dfe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:36:06.539192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a7ecf-5e9f-424e-a647-a89745cb5dfe None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-442a7ecf-5e9f-424e-a647-a89745cb5dfe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:36:06.548453 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:36:06.550125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:36:06.550125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:36:06.550125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:36:06.550125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:36:06.550125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:36:06.550125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:36:06.550125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:36:06.550125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:36:06.550125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:36:06.550125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:36:06.550125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:36:06.550125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:36:06.550125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:36:06.550125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:36:06.550125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:36:06.550125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:36:06.551728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:36:06.551728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:36:06.551728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:36:06.551728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:36:06.551728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:36:06.551728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:36:06.551728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:36:06.551728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:36:06.551728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:36:06.551728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:36:06.551728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:36:06.551728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:36:06.551728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 20:36:06.551728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:36:06.551728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 467/919] 10.222.0.61 () {56 vars in 1117 bytes} [Sat Sep 24 20:36:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:36:06.555566 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073e16b-d1d8-41fe-aab9-cf5b5f25553f None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:36:06.574058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:36:06.651255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073e16b-d1d8-41fe-aab9-cf5b5f25553f None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:36:06.685180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e123c26-e6c4-4d29-ba51-e26edf6ca2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:36:06.685713 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123c26-e6c4-4d29-ba51-e26edf6ca2c9 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:06.685989 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123c26-e6c4-4d29-ba51-e26edf6ca2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:06.686260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123c26-e6c4-4d29-ba51-e26edf6ca2c9 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:06.686873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e123c26-e6c4-4d29-ba51-e26edf6ca2c9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:36:06.687173 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e123c26-e6c4-4d29-ba51-e26edf6ca2c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:36:06.688538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e123c26-e6c4-4d29-ba51-e26edf6ca2c9 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:36:06.693359 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 453/920] 10.222.0.61 () {56 vars in 1116 bytes} [Sat Sep 24 20:36:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:36:06.699278 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a7ecf-5e9f-424e-a647-a89745cb5dfe None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:36:06.727662 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:36:06.797997 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a7ecf-5e9f-424e-a647-a89745cb5dfe None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:36:06.829770 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08fc49-bc53-4d4b-9636-ee9add078317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:36:06.830363 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08fc49-bc53-4d4b-9636-ee9add078317 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:06.830646 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08fc49-bc53-4d4b-9636-ee9add078317 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:06.830922 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08fc49-bc53-4d4b-9636-ee9add078317 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:06.831681 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08fc49-bc53-4d4b-9636-ee9add078317 None admin] RBAC: Adding query filter params (interface=public, service_id=f0767d34293245c39012caf8a7f7a968, region_id=RegionOne) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:36:06.832015 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08fc49-bc53-4d4b-9636-ee9add078317 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:36:06.833469 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08fc49-bc53-4d4b-9636-ee9add078317 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:36:06.838458 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 468/921] 10.222.0.61 () {56 vars in 1251 bytes} [Sat Sep 24 20:36:06 2022] GET /identity/v3/endpoints?service_id=f0767d34293245c39012caf8a7f7a968&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:36:06.844046 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e123c26-e6c4-4d29-ba51-e26edf6ca2c9 None admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:36:06.923023 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:36:06.940699 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e123c26-e6c4-4d29-ba51-e26edf6ca2c9 None admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:36:06.972651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3e13e-86c1-4e4b-9fb7-37a4451145b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:36:06.973237 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3e13e-86c1-4e4b-9fb7-37a4451145b1 None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:06.973514 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3e13e-86c1-4e4b-9fb7-37a4451145b1 None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:06.973784 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3e13e-86c1-4e4b-9fb7-37a4451145b1 None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:06.974367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3e13e-86c1-4e4b-9fb7-37a4451145b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:36:06.975700 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3e13e-86c1-4e4b-9fb7-37a4451145b1 None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:36:06.981887 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 454/922] 10.222.0.61 () {56 vars in 1087 bytes} [Sat Sep 24 20:36:06 2022] GET /identity/v3/services => generated 1962 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:36:09.415526 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c22be-5c47-4db8-9000-da44cfc6df0f None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:09.416035 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c22be-5c47-4db8-9000-da44cfc6df0f None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:09.416035 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c22be-5c47-4db8-9000-da44cfc6df0f None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:09.417364 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 469/923] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:36:09.422580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f10fd6-59d2-43a1-984a-5475ef5056e1 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:09.423012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f10fd6-59d2-43a1-984a-5475ef5056e1 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:09.423115 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f10fd6-59d2-43a1-984a-5475ef5056e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:09.440831 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-f9f10fd6-59d2-43a1-984a-5475ef5056e1 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:36:09.442005 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-f9f10fd6-59d2-43a1-984a-5475ef5056e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:36:09.506174 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 455/924] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:36:09 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 20:36:09.830607 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c22be-5c47-4db8-9000-da44cfc6df0f None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:36:09.921278 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:36:09.931987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c22be-5c47-4db8-9000-da44cfc6df0f None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:36:09.964349 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03af7ec-63c7-4838-8bbf-539a30cc66f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:36:09.964971 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03af7ec-63c7-4838-8bbf-539a30cc66f4 None admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:09.965246 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03af7ec-63c7-4838-8bbf-539a30cc66f4 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:09.965511 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03af7ec-63c7-4838-8bbf-539a30cc66f4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:09.966073 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03af7ec-63c7-4838-8bbf-539a30cc66f4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:36:09.967506 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03af7ec-63c7-4838-8bbf-539a30cc66f4 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application [None req-a03af7ec-63c7-4838-8bbf-539a30cc66f4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 20:36:09.976589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 20:36:09.977642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 20:36:09.977642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 20:36:09.977642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 20:36:09.977642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 20:36:09.977642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 20:36:09.977642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 20:36:09.977642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 20:36:09.977642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 20:36:09.977642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 20:36:09.977642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 20:36:09.977642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 20:36:09.977642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 20:36:09.977642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 20:36:09.977642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 20:36:09.977642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 20:36:09.977642 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 20:36:09.978790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 20:36:09.978790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application with Lock( Sep 24 20:36:09.978790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 20:36:09.978790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self._enter() Sep 24 20:36:09.978790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 20:36:09.978790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 20:36:09.978790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 20:36:09.978790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application return self.creator() Sep 24 20:36:09.978790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 20:36:09.978790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application created_value = creator( Sep 24 20:36:09.978790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 20:36:09.978790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 20:36:09.978790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 20:36:09.978790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: ERROR keystone.server.flask.application Sep 24 20:36:09.978790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 470/925] 10.222.0.61 () {56 vars in 1117 bytes} [Sat Sep 24 20:36:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 20:36:09.983611 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f10fd6-59d2-43a1-984a-5475ef5056e1 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:36:10.057100 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:36:10.079736 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f10fd6-59d2-43a1-984a-5475ef5056e1 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:36:10.112096 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db023d0-637a-4ff9-a564-418b9a17b99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:36:10.112663 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db023d0-637a-4ff9-a564-418b9a17b99b None admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:10.112938 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db023d0-637a-4ff9-a564-418b9a17b99b None admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:10.113205 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db023d0-637a-4ff9-a564-418b9a17b99b None admin] PATH_INFO: `/v3/services` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:10.113816 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db023d0-637a-4ff9-a564-418b9a17b99b None admin] RBAC: Adding query filter params (name=placement) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:36:10.114115 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db023d0-637a-4ff9-a564-418b9a17b99b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:36:10.115452 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db023d0-637a-4ff9-a564-418b9a17b99b None admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:36:10.120219 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 456/926] 10.222.0.61 () {56 vars in 1116 bytes} [Sat Sep 24 20:36:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:36:10.126192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03af7ec-63c7-4838-8bbf-539a30cc66f4 None admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:36:10.225751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03af7ec-63c7-4838-8bbf-539a30cc66f4 None admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:36:10.260733 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb80320-6c33-494f-bd34-eddcc5e99986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:36:10.261339 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb80320-6c33-494f-bd34-eddcc5e99986 None admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:36:10.261624 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb80320-6c33-494f-bd34-eddcc5e99986 None admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:36:10.261902 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb80320-6c33-494f-bd34-eddcc5e99986 None admin] PATH_INFO: `/v3/endpoints` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:36:10.262560 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb80320-6c33-494f-bd34-eddcc5e99986 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:36:10.263921 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb80320-6c33-494f-bd34-eddcc5e99986 None admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:36:10.283244 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 471/927] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Sep 24 20:36:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:36:20.117434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=30 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:36:20.278990 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:37:10.624986 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b8e82-e093-425f-a9b6-61f3c7152d35 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:10.625571 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b8e82-e093-425f-a9b6-61f3c7152d35 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:10.625571 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b8e82-e093-425f-a9b6-61f3c7152d35 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:10.627065 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 457/928] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:37:10.632450 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1375b91-68d5-4faa-aeec-24eda3bd1d55 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:10.632977 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1375b91-68d5-4faa-aeec-24eda3bd1d55 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:10.632977 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1375b91-68d5-4faa-aeec-24eda3bd1d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:10.652890 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-a1375b91-68d5-4faa-aeec-24eda3bd1d55 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:37:10.654169 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-a1375b91-68d5-4faa-aeec-24eda3bd1d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:37:10.726661 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 472/929] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:37:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:37:11.076824 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e47c2-2dc3-498e-97e0-3da9006f8237 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:11.077260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e47c2-2dc3-498e-97e0-3da9006f8237 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:11.077647 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e47c2-2dc3-498e-97e0-3da9006f8237 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:11.079474 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 458/930] 10.222.0.61 () {54 vars in 964 bytes} [Sat Sep 24 20:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:37:11.086197 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1e741-1189-423d-b6a7-42707edee50b None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:11.086397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1e741-1189-423d-b6a7-42707edee50b None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:11.086703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1e741-1189-423d-b6a7-42707edee50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:11.179628 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-01b1e741-1189-423d-b6a7-42707edee50b None None] MFA Rules not processed for user `0e97928ca3294ebdbc53468d84c64b26`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:37:11.180936 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-01b1e741-1189-423d-b6a7-42707edee50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:37:11.252157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 473/931] 10.222.0.61 () {58 vars in 1061 bytes} [Sat Sep 24 20:37:11 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:37:11.262069 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e47c2-2dc3-498e-97e0-3da9006f8237 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:37:11.274777 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e47c2-2dc3-498e-97e0-3da9006f8237 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:37:11.278963 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f409b9-b3e9-48c2-a578-5ecc5b27c763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:37:11.279725 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f409b9-b3e9-48c2-a578-5ecc5b27c763 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:11.280073 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f409b9-b3e9-48c2-a578-5ecc5b27c763 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:11.280443 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f409b9-b3e9-48c2-a578-5ecc5b27c763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:11.291830 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f409b9-b3e9-48c2-a578-5ecc5b27c763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:37:11.293437 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f409b9-b3e9-48c2-a578-5ecc5b27c763 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:37:11.308432 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 459/932] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:37:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:37:14.051874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932265f5-87b1-46e4-bf20-9a4368421645 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:14.052426 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932265f5-87b1-46e4-bf20-9a4368421645 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:14.052426 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932265f5-87b1-46e4-bf20-9a4368421645 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:14.053934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 474/933] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:37:14.059394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5eb40-a79a-47bb-84ba-04d4b62d760d None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:14.059882 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5eb40-a79a-47bb-84ba-04d4b62d760d None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:14.059959 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5eb40-a79a-47bb-84ba-04d4b62d760d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:14.081778 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-3ba5eb40-a79a-47bb-84ba-04d4b62d760d None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:37:14.082988 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-3ba5eb40-a79a-47bb-84ba-04d4b62d760d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:37:14.092369 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 460/934] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:37:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:37:14.427683 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932265f5-87b1-46e4-bf20-9a4368421645 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:37:14.438901 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932265f5-87b1-46e4-bf20-9a4368421645 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:37:14.442379 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c186226-c5af-4daf-82bb-2140dbb38fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:37:14.442973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c186226-c5af-4daf-82bb-2140dbb38fde service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:14.443253 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c186226-c5af-4daf-82bb-2140dbb38fde service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:14.443523 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c186226-c5af-4daf-82bb-2140dbb38fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:14.452780 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c186226-c5af-4daf-82bb-2140dbb38fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:37:14.454209 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c186226-c5af-4daf-82bb-2140dbb38fde service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:37:14.464817 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 475/935] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:37:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:37:17.168035 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff3dce-cd1f-4692-9714-1b66bb4a4362 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:17.168484 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff3dce-cd1f-4692-9714-1b66bb4a4362 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:17.168609 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff3dce-cd1f-4692-9714-1b66bb4a4362 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:17.170520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 461/936] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:37:17.175677 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce6d8e-fe41-45d5-a4c8-3f4e94652526 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:17.176113 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce6d8e-fe41-45d5-a4c8-3f4e94652526 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:17.176238 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce6d8e-fe41-45d5-a4c8-3f4e94652526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:17.213265 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-76ce6d8e-fe41-45d5-a4c8-3f4e94652526 None None] MFA Rules not processed for user `f016f79c903d413f83435d4998194d74`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:37:17.214468 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-76ce6d8e-fe41-45d5-a4c8-3f4e94652526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:37:17.257340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:37:17.285246 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 476/937] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:37:17 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:37:17.622882 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff3dce-cd1f-4692-9714-1b66bb4a4362 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:37:17.633477 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff3dce-cd1f-4692-9714-1b66bb4a4362 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:37:17.636887 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248b611-8fef-4165-b524-5d4436795b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:37:17.637479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248b611-8fef-4165-b524-5d4436795b45 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:17.637757 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248b611-8fef-4165-b524-5d4436795b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:17.638179 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248b611-8fef-4165-b524-5d4436795b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:17.646691 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248b611-8fef-4165-b524-5d4436795b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:37:17.648093 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248b611-8fef-4165-b524-5d4436795b45 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:37:17.657724 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 462/938] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:37:17 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:37:20.610193 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd6a8e-73cf-482e-9f64-fe5df9abc124 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:20.610698 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd6a8e-73cf-482e-9f64-fe5df9abc124 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:20.610698 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd6a8e-73cf-482e-9f64-fe5df9abc124 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:20.611977 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 477/939] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:37:20.617112 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00762a5-280d-450f-ac4b-dda3b6c90a1b None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:20.617529 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00762a5-280d-450f-ac4b-dda3b6c90a1b None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:20.617659 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00762a5-280d-450f-ac4b-dda3b6c90a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:20.636911 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-c00762a5-280d-450f-ac4b-dda3b6c90a1b None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:37:20.638766 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-c00762a5-280d-450f-ac4b-dda3b6c90a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:37:20.709090 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 463/940] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:37:20 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:37:21.049625 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd6a8e-73cf-482e-9f64-fe5df9abc124 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:37:21.060515 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd6a8e-73cf-482e-9f64-fe5df9abc124 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:37:21.063954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99559652-0caf-499c-b0bb-7d0fc6bf1571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:37:21.064565 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99559652-0caf-499c-b0bb-7d0fc6bf1571 service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:21.064845 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99559652-0caf-499c-b0bb-7d0fc6bf1571 service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:21.065116 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99559652-0caf-499c-b0bb-7d0fc6bf1571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:21.073676 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99559652-0caf-499c-b0bb-7d0fc6bf1571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:37:21.075086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99559652-0caf-499c-b0bb-7d0fc6bf1571 service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:37:21.084116 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 478/941] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:37:21 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:37:24.114155 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6401858-1b34-435b-a590-ede1dc625061 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:24.114656 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6401858-1b34-435b-a590-ede1dc625061 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:24.114656 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6401858-1b34-435b-a590-ede1dc625061 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:24.115954 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 464/942] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:37:24.121230 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd337c-cd2c-4da9-a5a6-b1659d9228e2 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:24.121617 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd337c-cd2c-4da9-a5a6-b1659d9228e2 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:24.121784 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd337c-cd2c-4da9-a5a6-b1659d9228e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:24.142379 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-8dbd337c-cd2c-4da9-a5a6-b1659d9228e2 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:37:24.143561 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-8dbd337c-cd2c-4da9-a5a6-b1659d9228e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:37:24.151217 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 479/943] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:37:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:37:24.503682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cc98a-41a0-4429-bb52-68b727829668 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:24.503965 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cc98a-41a0-4429-bb52-68b727829668 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:24.504240 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cc98a-41a0-4429-bb52-68b727829668 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:24.505584 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 465/944] 10.222.0.61 () {54 vars in 964 bytes} [Sat Sep 24 20:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:37:24.511521 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7939b8-7e7e-46f2-bf38-52a1fc589c3a None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:24.511870 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7939b8-7e7e-46f2-bf38-52a1fc589c3a None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:24.512212 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7939b8-7e7e-46f2-bf38-52a1fc589c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:24.532172 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-5a7939b8-7e7e-46f2-bf38-52a1fc589c3a None None] MFA Rules not processed for user `0e97928ca3294ebdbc53468d84c64b26`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:37:24.533506 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-5a7939b8-7e7e-46f2-bf38-52a1fc589c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:37:24.540026 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 480/945] 10.222.0.61 () {58 vars in 1061 bytes} [Sat Sep 24 20:37:24 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:37:24.549359 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cc98a-41a0-4429-bb52-68b727829668 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:37:24.559796 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cc98a-41a0-4429-bb52-68b727829668 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:37:24.563297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546abcd-8c2d-4825-9ec2-fc387580da58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:37:24.563879 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546abcd-8c2d-4825-9ec2-fc387580da58 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:24.564156 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546abcd-8c2d-4825-9ec2-fc387580da58 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:24.564460 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546abcd-8c2d-4825-9ec2-fc387580da58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:24.573059 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546abcd-8c2d-4825-9ec2-fc387580da58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:37:24.574488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546abcd-8c2d-4825-9ec2-fc387580da58 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:37:24.584933 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 466/946] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:37:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:37:27.240485 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb24d38-0efe-4eb1-afbe-4e3a005097cf None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:27.241003 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb24d38-0efe-4eb1-afbe-4e3a005097cf None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:27.241095 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb24d38-0efe-4eb1-afbe-4e3a005097cf None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:27.242389 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 481/947] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:37:27.248151 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31132a8b-154e-4eab-9789-39725460bcd5 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:27.248584 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31132a8b-154e-4eab-9789-39725460bcd5 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:27.248855 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31132a8b-154e-4eab-9789-39725460bcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:27.267920 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-31132a8b-154e-4eab-9789-39725460bcd5 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:37:27.269147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-31132a8b-154e-4eab-9789-39725460bcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:37:27.276807 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 467/948] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:37:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:37:27.613613 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb24d38-0efe-4eb1-afbe-4e3a005097cf None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:37:27.623951 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb24d38-0efe-4eb1-afbe-4e3a005097cf None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:37:27.627423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ade01-1257-4506-b20c-7f6eaeba08f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:37:27.628007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ade01-1257-4506-b20c-7f6eaeba08f9 service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:27.628298 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ade01-1257-4506-b20c-7f6eaeba08f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:27.628583 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ade01-1257-4506-b20c-7f6eaeba08f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:27.637399 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ade01-1257-4506-b20c-7f6eaeba08f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:37:27.638810 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ade01-1257-4506-b20c-7f6eaeba08f9 service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:37:27.647978 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 482/949] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:37:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:37:30.120466 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe56e51-af29-4c6b-8209-4bcb19706432 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:30.120972 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe56e51-af29-4c6b-8209-4bcb19706432 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:30.121062 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe56e51-af29-4c6b-8209-4bcb19706432 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:30.122462 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 468/950] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:37:30.127647 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b78f5-9d39-41a3-9fe4-262bb9b4cd15 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:30.128064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b78f5-9d39-41a3-9fe4-262bb9b4cd15 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:30.128200 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b78f5-9d39-41a3-9fe4-262bb9b4cd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:30.148700 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-2b5b78f5-9d39-41a3-9fe4-262bb9b4cd15 None None] MFA Rules not processed for user `f016f79c903d413f83435d4998194d74`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:37:30.149917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-2b5b78f5-9d39-41a3-9fe4-262bb9b4cd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:37:30.160946 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 483/951] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:37:30 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:37:30.496079 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe56e51-af29-4c6b-8209-4bcb19706432 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:37:30.507492 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe56e51-af29-4c6b-8209-4bcb19706432 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:37:30.510924 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfdb9ac-f111-4fee-b6a4-e5703ae02ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:37:30.511520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdb9ac-f111-4fee-b6a4-e5703ae02ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:30.511802 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdb9ac-f111-4fee-b6a4-e5703ae02ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:30.512082 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfdb9ac-f111-4fee-b6a4-e5703ae02ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:30.521449 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdb9ac-f111-4fee-b6a4-e5703ae02ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:37:30.522868 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfdb9ac-f111-4fee-b6a4-e5703ae02ba3 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:37:30.532135 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 469/952] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:37:30 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:37:33.129328 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f703be2-e8eb-44ba-bb75-7c7a81e2564a None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:33.129774 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f703be2-e8eb-44ba-bb75-7c7a81e2564a None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:33.129889 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f703be2-e8eb-44ba-bb75-7c7a81e2564a None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:33.131183 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 484/953] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:37:33.136731 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe18a6a-f61a-4004-ae6d-590f90e33b08 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:33.137156 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe18a6a-f61a-4004-ae6d-590f90e33b08 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:33.137293 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe18a6a-f61a-4004-ae6d-590f90e33b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:33.158567 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-1fe18a6a-f61a-4004-ae6d-590f90e33b08 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:37:33.159999 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-1fe18a6a-f61a-4004-ae6d-590f90e33b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:37:33.170994 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 470/954] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:37:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:37:33.515118 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f703be2-e8eb-44ba-bb75-7c7a81e2564a None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:37:33.526035 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f703be2-e8eb-44ba-bb75-7c7a81e2564a None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:37:33.529602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ed2d9-200b-49df-8663-7d0ffc02c60b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:37:33.530192 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ed2d9-200b-49df-8663-7d0ffc02c60b service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:33.530471 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ed2d9-200b-49df-8663-7d0ffc02c60b service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:33.530742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ed2d9-200b-49df-8663-7d0ffc02c60b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:33.539964 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ed2d9-200b-49df-8663-7d0ffc02c60b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:37:33.541442 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ed2d9-200b-49df-8663-7d0ffc02c60b service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:37:33.554369 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 485/955] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:37:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:37:36.018039 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88972613-23ea-4662-bb3c-b4e9af5671a9 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:36.018629 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88972613-23ea-4662-bb3c-b4e9af5671a9 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:36.018629 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88972613-23ea-4662-bb3c-b4e9af5671a9 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:36.019880 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 471/956] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:37:36.025183 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ee7a6-a885-4984-a5ab-29cf6ebf2d18 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:36.025606 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ee7a6-a885-4984-a5ab-29cf6ebf2d18 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:36.025742 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ee7a6-a885-4984-a5ab-29cf6ebf2d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:36.045620 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-fe6ee7a6-a885-4984-a5ab-29cf6ebf2d18 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:37:36.046808 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-fe6ee7a6-a885-4984-a5ab-29cf6ebf2d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:37:36.055658 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 486/957] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:37:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:37:36.394968 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88972613-23ea-4662-bb3c-b4e9af5671a9 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:37:36.406524 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88972613-23ea-4662-bb3c-b4e9af5671a9 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:37:36.410028 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fbe63-131e-4e98-82b6-36ddda33ff18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:37:36.410621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fbe63-131e-4e98-82b6-36ddda33ff18 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:36.410908 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fbe63-131e-4e98-82b6-36ddda33ff18 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:36.411183 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fbe63-131e-4e98-82b6-36ddda33ff18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:36.420920 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fbe63-131e-4e98-82b6-36ddda33ff18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:37:36.422272 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fbe63-131e-4e98-82b6-36ddda33ff18 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:37:36.431387 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 472/958] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:37:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:37:39.153606 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea05358-985e-4b9d-9028-829889bf0d53 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:39.154123 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea05358-985e-4b9d-9028-829889bf0d53 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:39.154123 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea05358-985e-4b9d-9028-829889bf0d53 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:39.155400 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 487/959] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:37:39.160868 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f8476-b61b-46ab-83c0-ddf7459ac488 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:39.161301 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f8476-b61b-46ab-83c0-ddf7459ac488 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:39.161434 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f8476-b61b-46ab-83c0-ddf7459ac488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:39.181247 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-318f8476-b61b-46ab-83c0-ddf7459ac488 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:37:39.182440 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-318f8476-b61b-46ab-83c0-ddf7459ac488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:37:39.190779 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 473/960] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:37:39 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:37:39.524792 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea05358-985e-4b9d-9028-829889bf0d53 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:37:39.537785 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea05358-985e-4b9d-9028-829889bf0d53 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:37:39.541506 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b755b-c918-43ce-a8f6-a1c85871c03d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:37:39.542089 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b755b-c918-43ce-a8f6-a1c85871c03d service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:39.542361 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b755b-c918-43ce-a8f6-a1c85871c03d service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:39.542629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b755b-c918-43ce-a8f6-a1c85871c03d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:39.551734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b755b-c918-43ce-a8f6-a1c85871c03d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:37:39.553165 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b755b-c918-43ce-a8f6-a1c85871c03d service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:37:39.562203 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 488/961] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:37:39 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:37:43.873594 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dedcc1-8104-4cc4-a125-9f197c1098a7 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:43.874097 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dedcc1-8104-4cc4-a125-9f197c1098a7 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:43.874200 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dedcc1-8104-4cc4-a125-9f197c1098a7 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:43.875462 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 474/962] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:37:43.880640 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ac03c-56c7-4688-935d-f226ef3d5007 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:43.881032 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ac03c-56c7-4688-935d-f226ef3d5007 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:43.881196 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ac03c-56c7-4688-935d-f226ef3d5007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:43.902860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-214ac03c-56c7-4688-935d-f226ef3d5007 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:37:43.904206 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-214ac03c-56c7-4688-935d-f226ef3d5007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:37:43.912254 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 489/963] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:37:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:37:44.247322 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dedcc1-8104-4cc4-a125-9f197c1098a7 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:37:44.252823 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=74 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:37:44.259398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dedcc1-8104-4cc4-a125-9f197c1098a7 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:37:44.262934 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c4d56-8bf6-4a49-a57f-1394160bfdc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:37:44.263525 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c4d56-8bf6-4a49-a57f-1394160bfdc5 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:44.263803 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c4d56-8bf6-4a49-a57f-1394160bfdc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:44.264074 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c4d56-8bf6-4a49-a57f-1394160bfdc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:44.273142 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c4d56-8bf6-4a49-a57f-1394160bfdc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:37:44.274555 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c4d56-8bf6-4a49-a57f-1394160bfdc5 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:37:44.284033 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 475/964] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:37:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:37:47.335893 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960d02-7451-4027-86e7-20a63b619285 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:47.336438 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960d02-7451-4027-86e7-20a63b619285 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:47.336595 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80960d02-7451-4027-86e7-20a63b619285 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:47.337940 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 490/965] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:37:47.343142 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed01114-8c30-4e9f-9a31-2a36f0c3b465 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:47.343546 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed01114-8c30-4e9f-9a31-2a36f0c3b465 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:47.343695 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed01114-8c30-4e9f-9a31-2a36f0c3b465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:47.363191 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-5ed01114-8c30-4e9f-9a31-2a36f0c3b465 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:37:47.364411 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-5ed01114-8c30-4e9f-9a31-2a36f0c3b465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:37:47.372877 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 476/966] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:37:47 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:37:47.707538 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80960d02-7451-4027-86e7-20a63b619285 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:37:47.712872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=51 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:37:47.719286 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80960d02-7451-4027-86e7-20a63b619285 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:37:47.722729 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76988-38b9-45d8-8ecb-1536354f4b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:37:47.723316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76988-38b9-45d8-8ecb-1536354f4b1c service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:47.723593 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76988-38b9-45d8-8ecb-1536354f4b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:47.723868 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76988-38b9-45d8-8ecb-1536354f4b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:47.732683 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb76988-38b9-45d8-8ecb-1536354f4b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:37:47.734086 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb76988-38b9-45d8-8ecb-1536354f4b1c service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:37:47.743213 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 491/967] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:37:47 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:37:52.710653 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a86466-8691-47f3-8ef0-442c56c5f816 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:52.711219 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a86466-8691-47f3-8ef0-442c56c5f816 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:52.711219 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a86466-8691-47f3-8ef0-442c56c5f816 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:52.712551 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 477/968] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:37:52.718322 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe995a3-e485-495c-b535-b13353f065bb None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:52.718711 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe995a3-e485-495c-b535-b13353f065bb None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:52.718868 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe995a3-e485-495c-b535-b13353f065bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:52.739660 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-bfe995a3-e485-495c-b535-b13353f065bb None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:37:52.740890 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-bfe995a3-e485-495c-b535-b13353f065bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:37:52.748689 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 492/969] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:37:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:37:53.086361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a86466-8691-47f3-8ef0-442c56c5f816 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:37:53.097557 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a86466-8691-47f3-8ef0-442c56c5f816 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:37:53.101076 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b03832-723d-4dc8-a4e3-2ef5fa5a9e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:37:53.101668 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b03832-723d-4dc8-a4e3-2ef5fa5a9e1c service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:53.101943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b03832-723d-4dc8-a4e3-2ef5fa5a9e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:53.102213 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b03832-723d-4dc8-a4e3-2ef5fa5a9e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:53.111755 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b03832-723d-4dc8-a4e3-2ef5fa5a9e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:37:53.113197 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b03832-723d-4dc8-a4e3-2ef5fa5a9e1c service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:37:53.122474 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 478/970] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:37:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:37:58.558714 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03081386-56fb-458d-b8ba-ca2718a63efc None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:58.559522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03081386-56fb-458d-b8ba-ca2718a63efc None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:58.560025 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03081386-56fb-458d-b8ba-ca2718a63efc None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:58.562619 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 493/971] 10.222.0.61 () {54 vars in 921 bytes} [Sat Sep 24 20:37:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:37:58.571284 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879a6a2-40b9-4148-a23c-83eab5959dc6 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:37:58.571755 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879a6a2-40b9-4148-a23c-83eab5959dc6 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:37:58.572080 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879a6a2-40b9-4148-a23c-83eab5959dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:37:58.622181 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-8879a6a2-40b9-4148-a23c-83eab5959dc6 None None] MFA Rules not processed for user `d3060c5a247f495990fd7eec99c0ee0a`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:37:58.623762 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-8879a6a2-40b9-4148-a23c-83eab5959dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:37:58.699600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 479/972] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Sep 24 20:37:58 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:02.734322 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=8 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:38:03.231346 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba80d-2712-4ba4-a374-0a7609a05e7f None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:03.231910 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba80d-2712-4ba4-a374-0a7609a05e7f None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:03.232363 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba80d-2712-4ba4-a374-0a7609a05e7f None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:03.234320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 494/973] 10.222.0.61 () {54 vars in 921 bytes} [Sat Sep 24 20:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:03.240044 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc98b41-6dbf-47c9-9b7d-9826e3fcf5a3 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:03.240596 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc98b41-6dbf-47c9-9b7d-9826e3fcf5a3 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:03.240865 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc98b41-6dbf-47c9-9b7d-9826e3fcf5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:03.262104 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-dfc98b41-6dbf-47c9-9b7d-9826e3fcf5a3 None None] MFA Rules not processed for user `d3060c5a247f495990fd7eec99c0ee0a`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:03.263299 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-dfc98b41-6dbf-47c9-9b7d-9826e3fcf5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:03.271776 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 480/974] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Sep 24 20:38:03 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:04.792604 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e05163-5e0c-4d83-a123-4f9f1855d38c None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:04.793165 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e05163-5e0c-4d83-a123-4f9f1855d38c None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:04.793165 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e05163-5e0c-4d83-a123-4f9f1855d38c None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:04.794466 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 495/975] 10.222.0.61 () {54 vars in 921 bytes} [Sat Sep 24 20:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:04.799611 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456d961-e9cd-4133-8640-ddb3b55ed73e None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:04.800038 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456d961-e9cd-4133-8640-ddb3b55ed73e None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:04.800164 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456d961-e9cd-4133-8640-ddb3b55ed73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:04.820030 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-2456d961-e9cd-4133-8640-ddb3b55ed73e None None] MFA Rules not processed for user `d3060c5a247f495990fd7eec99c0ee0a`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:04.821231 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-2456d961-e9cd-4133-8640-ddb3b55ed73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:04.830106 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 481/976] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Sep 24 20:38:04 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:08.952686 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac8ebf-d030-4559-b527-a0cd7d5496c5 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:08.953240 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac8ebf-d030-4559-b527-a0cd7d5496c5 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:08.953240 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac8ebf-d030-4559-b527-a0cd7d5496c5 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:08.958150 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 496/977] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:08.959860 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71ff12-2d88-43d9-8754-3f8d0e82f89f None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:08.960274 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71ff12-2d88-43d9-8754-3f8d0e82f89f None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:08.960523 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e71ff12-2d88-43d9-8754-3f8d0e82f89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:08.980393 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-8e71ff12-2d88-43d9-8754-3f8d0e82f89f None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:08.981876 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-8e71ff12-2d88-43d9-8754-3f8d0e82f89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:08.990708 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 482/978] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:38:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:09.349301 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ab218-5154-454a-bd4d-0031cee457f4 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:09.350636 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ab218-5154-454a-bd4d-0031cee457f4 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:09.351219 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ab218-5154-454a-bd4d-0031cee457f4 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:09.353299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 497/979] 10.222.0.61 () {54 vars in 961 bytes} [Sat Sep 24 20:38:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:09.362210 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144f509-70a4-474c-9ef7-98e6b1e64531 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:09.363000 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144f509-70a4-474c-9ef7-98e6b1e64531 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:09.363481 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144f509-70a4-474c-9ef7-98e6b1e64531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:09.405449 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-9144f509-70a4-474c-9ef7-98e6b1e64531 None None] MFA Rules not processed for user `bc96ad30b91b46af92ff5b27a6b83abd`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:09.407563 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-9144f509-70a4-474c-9ef7-98e6b1e64531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:09.497313 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:38:09.503377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 483/980] 10.222.0.61 () {58 vars in 1058 bytes} [Sat Sep 24 20:38:09 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:09.512741 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ab218-5154-454a-bd4d-0031cee457f4 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:09.527274 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ab218-5154-454a-bd4d-0031cee457f4 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:09.532382 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2935385-bb95-4a46-8c76-51b9e125ca73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:09.532969 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2935385-bb95-4a46-8c76-51b9e125ca73 service nova] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:09.533245 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2935385-bb95-4a46-8c76-51b9e125ca73 service nova] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:09.533520 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2935385-bb95-4a46-8c76-51b9e125ca73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:09.542609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2935385-bb95-4a46-8c76-51b9e125ca73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:09.544180 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2935385-bb95-4a46-8c76-51b9e125ca73 service nova] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:09.553601 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 498/981] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:38:12.189814 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c377b-55ed-4409-99a0-273de19a0093 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:12.190730 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c377b-55ed-4409-99a0-273de19a0093 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:12.191118 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c377b-55ed-4409-99a0-273de19a0093 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:12.192659 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 484/982] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:12.198125 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0d8a3-ae39-4cf3-82fd-0da6bd9fc5ee None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:12.198619 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0d8a3-ae39-4cf3-82fd-0da6bd9fc5ee None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:12.199050 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0d8a3-ae39-4cf3-82fd-0da6bd9fc5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:12.218758 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-95a0d8a3-ae39-4cf3-82fd-0da6bd9fc5ee None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:12.219941 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-95a0d8a3-ae39-4cf3-82fd-0da6bd9fc5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:12.227765 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 499/983] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:38:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:12.584178 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c377b-55ed-4409-99a0-273de19a0093 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:12.608297 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c377b-55ed-4409-99a0-273de19a0093 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:12.613251 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0175cc-91fc-4803-95ee-c83adb289d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:12.613962 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0175cc-91fc-4803-95ee-c83adb289d56 service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:12.614395 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0175cc-91fc-4803-95ee-c83adb289d56 service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:12.614810 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0175cc-91fc-4803-95ee-c83adb289d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:12.624212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0175cc-91fc-4803-95ee-c83adb289d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:12.625904 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0175cc-91fc-4803-95ee-c83adb289d56 service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:12.636715 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 485/984] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:38:15.398358 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e10e7-18f0-4286-b2c6-296c9f4f4fa5 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:15.398924 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e10e7-18f0-4286-b2c6-296c9f4f4fa5 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:15.398924 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e10e7-18f0-4286-b2c6-296c9f4f4fa5 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:15.400315 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 500/985] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:15.406116 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1ca6c-aec9-4318-a256-6fbe342d7fac None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:15.406548 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1ca6c-aec9-4318-a256-6fbe342d7fac None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:15.407116 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1ca6c-aec9-4318-a256-6fbe342d7fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:15.429854 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-28d1ca6c-aec9-4318-a256-6fbe342d7fac None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:15.431097 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-28d1ca6c-aec9-4318-a256-6fbe342d7fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:15.442063 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 486/986] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:38:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:15.796610 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a4969-1ae7-4c2d-b9e1-5df9c0d8c8b0 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:15.797399 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a4969-1ae7-4c2d-b9e1-5df9c0d8c8b0 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:15.797986 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a4969-1ae7-4c2d-b9e1-5df9c0d8c8b0 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:15.800141 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 501/987] 10.222.0.61 () {54 vars in 961 bytes} [Sat Sep 24 20:38:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:15.806634 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbd2ff-1406-44bc-b614-a698b9bbc687 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:15.807060 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbd2ff-1406-44bc-b614-a698b9bbc687 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:15.807547 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbd2ff-1406-44bc-b614-a698b9bbc687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:15.832979 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-3edbd2ff-1406-44bc-b614-a698b9bbc687 None None] MFA Rules not processed for user `bc96ad30b91b46af92ff5b27a6b83abd`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:15.835027 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-3edbd2ff-1406-44bc-b614-a698b9bbc687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:15.846441 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 487/988] 10.222.0.61 () {58 vars in 1058 bytes} [Sat Sep 24 20:38:15 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:15.854360 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a4969-1ae7-4c2d-b9e1-5df9c0d8c8b0 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:15.868422 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a4969-1ae7-4c2d-b9e1-5df9c0d8c8b0 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:15.874984 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaaa02-55d4-4c52-8793-55c094d621d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:15.876074 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaaa02-55d4-4c52-8793-55c094d621d2 service nova] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:15.876454 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaaa02-55d4-4c52-8793-55c094d621d2 service nova] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:15.876806 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaaa02-55d4-4c52-8793-55c094d621d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:15.886720 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfaaa02-55d4-4c52-8793-55c094d621d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:15.888408 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfaaa02-55d4-4c52-8793-55c094d621d2 service nova] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:15.899007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 502/989] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:38:18.488813 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25724b1-8893-4ecd-9315-c55394082d55 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:18.489316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25724b1-8893-4ecd-9315-c55394082d55 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:18.489316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25724b1-8893-4ecd-9315-c55394082d55 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:18.494497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 488/990] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:38:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:18.496611 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d5005-f6dd-4276-a95d-48ae0334e93a None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:18.497353 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d5005-f6dd-4276-a95d-48ae0334e93a None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:18.497774 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d5005-f6dd-4276-a95d-48ae0334e93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:18.523523 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-7e3d5005-f6dd-4276-a95d-48ae0334e93a None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:18.525009 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-7e3d5005-f6dd-4276-a95d-48ae0334e93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:18.534088 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 503/991] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:38:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:18.953274 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25724b1-8893-4ecd-9315-c55394082d55 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:18.968529 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25724b1-8893-4ecd-9315-c55394082d55 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:18.973758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5a349-dc55-4d48-8a2e-ad94bfae7cee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:18.974361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5a349-dc55-4d48-8a2e-ad94bfae7cee service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:18.974632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5a349-dc55-4d48-8a2e-ad94bfae7cee service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:18.975494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5a349-dc55-4d48-8a2e-ad94bfae7cee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:18.993371 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5a349-dc55-4d48-8a2e-ad94bfae7cee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:18.995646 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5a349-dc55-4d48-8a2e-ad94bfae7cee service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:19.007196 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 489/992] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:38:19.193310 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb3bef-bd05-45f7-9b56-6688dce2dd95 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:19.193603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb3bef-bd05-45f7-9b56-6688dce2dd95 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:19.193888 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb3bef-bd05-45f7-9b56-6688dce2dd95 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:19.195273 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 504/993] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:19.201720 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cddd5-c0f9-45fc-b929-875a9790ef32 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:19.202030 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cddd5-c0f9-45fc-b929-875a9790ef32 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:19.202623 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cddd5-c0f9-45fc-b929-875a9790ef32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:19.225685 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-817cddd5-c0f9-45fc-b929-875a9790ef32 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:19.226949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-817cddd5-c0f9-45fc-b929-875a9790ef32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:19.235826 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 490/994] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:38:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:19.635973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b0103-e3a2-4202-a8b7-49cd8b251d00 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:19.635973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b0103-e3a2-4202-a8b7-49cd8b251d00 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:19.635973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b0103-e3a2-4202-a8b7-49cd8b251d00 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:19.635973 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 505/995] 10.222.0.61 () {54 vars in 963 bytes} [Sat Sep 24 20:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:19.642918 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e13d52-8158-4639-90f7-3f16385e9718 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:19.643398 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e13d52-8158-4639-90f7-3f16385e9718 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:19.643490 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e13d52-8158-4639-90f7-3f16385e9718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:19.684031 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-80e13d52-8158-4639-90f7-3f16385e9718 None None] MFA Rules not processed for user `9e6e1fa10cb9487d8b346800e360c7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:19.685366 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-80e13d52-8158-4639-90f7-3f16385e9718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:19.747320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 491/996] 10.222.0.61 () {58 vars in 1060 bytes} [Sat Sep 24 20:38:19 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:19.754869 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b0103-e3a2-4202-a8b7-49cd8b251d00 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:19.766174 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b0103-e3a2-4202-a8b7-49cd8b251d00 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:19.769771 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32dca0-d969-4189-9d47-7af99b2c015b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6e1fa10cb9487d8b346800e360c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:19.770474 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32dca0-d969-4189-9d47-7af99b2c015b service cinder] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:19.770884 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32dca0-d969-4189-9d47-7af99b2c015b service cinder] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:19.771291 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32dca0-d969-4189-9d47-7af99b2c015b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:19.781462 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32dca0-d969-4189-9d47-7af99b2c015b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:19.783332 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e32dca0-d969-4189-9d47-7af99b2c015b service cinder] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:19.794508 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 506/997] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:38:21.491922 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe89947-1c4e-49fe-84f9-6853ef02d579 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:21.492496 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe89947-1c4e-49fe-84f9-6853ef02d579 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:21.492496 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe89947-1c4e-49fe-84f9-6853ef02d579 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:21.493809 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 492/998] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:21.499140 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4d664-681c-425e-af0f-254ff550e020 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:21.499536 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4d664-681c-425e-af0f-254ff550e020 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:21.499687 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4d664-681c-425e-af0f-254ff550e020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:21.518297 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-37d4d664-681c-425e-af0f-254ff550e020 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:21.519473 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-37d4d664-681c-425e-af0f-254ff550e020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:21.532419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 507/999] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:38:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:21.882534 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe89947-1c4e-49fe-84f9-6853ef02d579 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:21.898058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe89947-1c4e-49fe-84f9-6853ef02d579 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:21.903637 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202fd83-bce2-4fd8-9228-04f3ddbcd0e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:21.904240 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202fd83-bce2-4fd8-9228-04f3ddbcd0e7 service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:21.904557 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202fd83-bce2-4fd8-9228-04f3ddbcd0e7 service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:21.904827 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202fd83-bce2-4fd8-9228-04f3ddbcd0e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:21.913139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202fd83-bce2-4fd8-9228-04f3ddbcd0e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:21.914960 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202fd83-bce2-4fd8-9228-04f3ddbcd0e7 service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:21.924546 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 493/1000] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:38:24.403930 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffa7f0-11e2-4496-9ea2-c9590d08fbc9 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:24.404497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffa7f0-11e2-4496-9ea2-c9590d08fbc9 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:24.404497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffa7f0-11e2-4496-9ea2-c9590d08fbc9 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:24.405828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 508/1001] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:24.410928 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb2b33-5049-4f8f-94a3-5299c0d1af7c None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:24.411322 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb2b33-5049-4f8f-94a3-5299c0d1af7c None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:24.411479 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb2b33-5049-4f8f-94a3-5299c0d1af7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:24.431521 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-74eb2b33-5049-4f8f-94a3-5299c0d1af7c None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:24.434273 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-74eb2b33-5049-4f8f-94a3-5299c0d1af7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:24.440621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 494/1002] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:38:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:24.790577 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffa7f0-11e2-4496-9ea2-c9590d08fbc9 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:24.806698 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffa7f0-11e2-4496-9ea2-c9590d08fbc9 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:24.812321 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed904079-8413-472f-9bec-3c6b228bf243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:24.812952 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed904079-8413-472f-9bec-3c6b228bf243 service nova] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:24.813232 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed904079-8413-472f-9bec-3c6b228bf243 service nova] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:24.813505 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed904079-8413-472f-9bec-3c6b228bf243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:24.822016 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed904079-8413-472f-9bec-3c6b228bf243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:24.824095 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed904079-8413-472f-9bec-3c6b228bf243 service nova] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:24.834073 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 509/1003] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:38:27.296296 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38d559-bd4d-4af7-8c64-f0dd731b4dbd None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:27.296832 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38d559-bd4d-4af7-8c64-f0dd731b4dbd None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:27.296832 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38d559-bd4d-4af7-8c64-f0dd731b4dbd None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:27.298135 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 495/1004] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:27.303528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627d2ba-7354-4a12-86ea-3d6d71cdd278 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:27.304430 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627d2ba-7354-4a12-86ea-3d6d71cdd278 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:27.304907 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627d2ba-7354-4a12-86ea-3d6d71cdd278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:27.325076 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-1627d2ba-7354-4a12-86ea-3d6d71cdd278 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:27.326259 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-1627d2ba-7354-4a12-86ea-3d6d71cdd278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:27.334031 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 510/1005] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:38:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:27.677227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38d559-bd4d-4af7-8c64-f0dd731b4dbd None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:27.691791 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38d559-bd4d-4af7-8c64-f0dd731b4dbd None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:27.697212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01fc8f-0da4-4833-8ea6-b23eb00a83d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:27.698312 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01fc8f-0da4-4833-8ea6-b23eb00a83d6 service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:27.698590 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01fc8f-0da4-4833-8ea6-b23eb00a83d6 service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:27.698863 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01fc8f-0da4-4833-8ea6-b23eb00a83d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:27.707765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01fc8f-0da4-4833-8ea6-b23eb00a83d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:27.709423 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01fc8f-0da4-4833-8ea6-b23eb00a83d6 service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:27.720065 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 496/1006] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:38:30.493459 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba7e66-4673-461e-b8f4-3488e922a2ce None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:30.494577 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba7e66-4673-461e-b8f4-3488e922a2ce None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:30.494577 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba7e66-4673-461e-b8f4-3488e922a2ce None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:30.496183 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 511/1007] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:38:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:30.501531 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab05ff5-e485-4b76-b851-cefe6b782097 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:30.501992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab05ff5-e485-4b76-b851-cefe6b782097 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:30.502101 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab05ff5-e485-4b76-b851-cefe6b782097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:30.526017 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-fab05ff5-e485-4b76-b851-cefe6b782097 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:30.527230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-fab05ff5-e485-4b76-b851-cefe6b782097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:30.535058 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 497/1008] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:38:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:30.888225 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba7e66-4673-461e-b8f4-3488e922a2ce None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:30.906631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba7e66-4673-461e-b8f4-3488e922a2ce None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:30.913211 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9bd91-428a-4d78-8d6b-727f3749bd44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:30.914311 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9bd91-428a-4d78-8d6b-727f3749bd44 service nova] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:30.914668 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9bd91-428a-4d78-8d6b-727f3749bd44 service nova] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:30.915088 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9bd91-428a-4d78-8d6b-727f3749bd44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:30.926280 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9bd91-428a-4d78-8d6b-727f3749bd44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:30.928534 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9bd91-428a-4d78-8d6b-727f3749bd44 service nova] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:30.940987 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 512/1009] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:38:34.073535 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74450570-f9d7-474a-ad68-b6ed3c44591c None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:34.074523 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74450570-f9d7-474a-ad68-b6ed3c44591c None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:34.074523 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74450570-f9d7-474a-ad68-b6ed3c44591c None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:34.076191 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 498/1010] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:38:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:34.081589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667ae14-bd2a-4448-a06f-7c7cd305aa2b None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:34.082054 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667ae14-bd2a-4448-a06f-7c7cd305aa2b None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:34.082156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667ae14-bd2a-4448-a06f-7c7cd305aa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:34.090330 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=43 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:38:34.103380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-5667ae14-bd2a-4448-a06f-7c7cd305aa2b None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:34.105182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-5667ae14-bd2a-4448-a06f-7c7cd305aa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:34.113103 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 513/1011] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:38:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:34.457852 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74450570-f9d7-474a-ad68-b6ed3c44591c None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:34.472543 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74450570-f9d7-474a-ad68-b6ed3c44591c None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:34.477561 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23621ae-a004-455a-ae87-363f93c1c531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:34.478165 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23621ae-a004-455a-ae87-363f93c1c531 service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:34.478985 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23621ae-a004-455a-ae87-363f93c1c531 service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:34.479277 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23621ae-a004-455a-ae87-363f93c1c531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:34.487430 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23621ae-a004-455a-ae87-363f93c1c531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:34.489061 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23621ae-a004-455a-ae87-363f93c1c531 service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:34.499735 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 499/1012] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:38:36.016174 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76c7a8-7fae-4490-a50c-f86b1b96df85 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:36.016794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76c7a8-7fae-4490-a50c-f86b1b96df85 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:36.016794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76c7a8-7fae-4490-a50c-f86b1b96df85 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:36.018078 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 514/1013] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:36.023513 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762ed7c-294f-496a-8040-0ab04dd5dc43 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:36.023962 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762ed7c-294f-496a-8040-0ab04dd5dc43 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:36.024191 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762ed7c-294f-496a-8040-0ab04dd5dc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:36.044022 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-d762ed7c-294f-496a-8040-0ab04dd5dc43 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:36.045236 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-d762ed7c-294f-496a-8040-0ab04dd5dc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:36.052876 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 500/1014] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:38:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:36.408600 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46aedf-4c82-45f6-9db3-2429a0ec2ce5 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:36.408884 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46aedf-4c82-45f6-9db3-2429a0ec2ce5 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:36.409158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46aedf-4c82-45f6-9db3-2429a0ec2ce5 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:36.410488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 515/1015] 10.222.0.61 () {54 vars in 962 bytes} [Sat Sep 24 20:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:36.415968 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c36801-e7e3-474e-b9fa-77410c8a282c None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:36.416253 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c36801-e7e3-474e-b9fa-77410c8a282c None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:36.416580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c36801-e7e3-474e-b9fa-77410c8a282c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:36.454188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-d0c36801-e7e3-474e-b9fa-77410c8a282c None None] MFA Rules not processed for user `b505bdb933aa4bffa870851e4cb87c59`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:36.455294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-d0c36801-e7e3-474e-b9fa-77410c8a282c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:36.475402 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:38:36.516896 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 501/1016] 10.222.0.61 () {58 vars in 1059 bytes} [Sat Sep 24 20:38:36 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:36.524952 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46aedf-4c82-45f6-9db3-2429a0ec2ce5 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:36.536831 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46aedf-4c82-45f6-9db3-2429a0ec2ce5 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:36.540716 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870179a-9654-4ed3-ae40-d0cec3b272e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b505bdb933aa4bffa870851e4cb87c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:36.541313 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870179a-9654-4ed3-ae40-d0cec3b272e9 service glance] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:36.541590 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870179a-9654-4ed3-ae40-d0cec3b272e9 service glance] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:36.541858 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870179a-9654-4ed3-ae40-d0cec3b272e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:36.551024 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870179a-9654-4ed3-ae40-d0cec3b272e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:36.552482 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870179a-9654-4ed3-ae40-d0cec3b272e9 service glance] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:36.562123 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 516/1017] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:38:36.939976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66776907-6068-48d0-bf7c-69092b8b7fc6 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:36.940263 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66776907-6068-48d0-bf7c-69092b8b7fc6 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:36.940574 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66776907-6068-48d0-bf7c-69092b8b7fc6 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:36.941887 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 502/1018] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:36.947265 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a869b9-36e7-4a9f-bd70-1b08ebe4003e None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:36.947560 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a869b9-36e7-4a9f-bd70-1b08ebe4003e None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:36.947854 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a869b9-36e7-4a9f-bd70-1b08ebe4003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:36.966989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-63a869b9-36e7-4a9f-bd70-1b08ebe4003e None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:36.968098 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-63a869b9-36e7-4a9f-bd70-1b08ebe4003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:36.975789 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 517/1019] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:38:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:37.322153 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66776907-6068-48d0-bf7c-69092b8b7fc6 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:37.337508 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66776907-6068-48d0-bf7c-69092b8b7fc6 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:37.342421 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b50f7-24db-45ec-b870-dec37118b721 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:37.343020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b50f7-24db-45ec-b870-dec37118b721 service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:37.343300 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b50f7-24db-45ec-b870-dec37118b721 service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:37.343574 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b50f7-24db-45ec-b870-dec37118b721 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:37.354740 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b50f7-24db-45ec-b870-dec37118b721 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:37.356323 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b50f7-24db-45ec-b870-dec37118b721 service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:37.366516 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 503/1020] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:38:39.899186 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ec27d-7cb0-4d42-bf6e-55615aacd424 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:39.899796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ec27d-7cb0-4d42-bf6e-55615aacd424 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:39.899796 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ec27d-7cb0-4d42-bf6e-55615aacd424 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:39.901832 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 518/1021] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:39.907727 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0a429-76e7-4d5c-8e79-c4f87b7d1648 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:39.908212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0a429-76e7-4d5c-8e79-c4f87b7d1648 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:39.908314 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0a429-76e7-4d5c-8e79-c4f87b7d1648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:39.928270 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-0ca0a429-76e7-4d5c-8e79-c4f87b7d1648 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:39.929512 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-0ca0a429-76e7-4d5c-8e79-c4f87b7d1648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:39.940509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 504/1022] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:38:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:40.287405 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ec27d-7cb0-4d42-bf6e-55615aacd424 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:40.301342 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ec27d-7cb0-4d42-bf6e-55615aacd424 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:40.306211 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc28e90-32ad-42d5-91e3-b423a3f4b6f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:40.307441 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc28e90-32ad-42d5-91e3-b423a3f4b6f9 service nova] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:40.307711 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc28e90-32ad-42d5-91e3-b423a3f4b6f9 service nova] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:40.307985 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc28e90-32ad-42d5-91e3-b423a3f4b6f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:40.316779 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc28e90-32ad-42d5-91e3-b423a3f4b6f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:40.318501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc28e90-32ad-42d5-91e3-b423a3f4b6f9 service nova] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:40.330494 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 519/1023] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:38:42.917098 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fedfa-dd90-41bd-8112-6e33bc8c6748 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:42.917742 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fedfa-dd90-41bd-8112-6e33bc8c6748 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:42.917742 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fedfa-dd90-41bd-8112-6e33bc8c6748 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:42.918955 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 505/1024] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:42.924250 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9122-1daa-4207-8913-5eff5456d0d0 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:42.924763 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9122-1daa-4207-8913-5eff5456d0d0 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:42.924862 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9122-1daa-4207-8913-5eff5456d0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:42.950839 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-b8af9122-1daa-4207-8913-5eff5456d0d0 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:42.952645 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-b8af9122-1daa-4207-8913-5eff5456d0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:42.963253 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 520/1025] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:38:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:43.304511 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fedfa-dd90-41bd-8112-6e33bc8c6748 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:43.318379 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fedfa-dd90-41bd-8112-6e33bc8c6748 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:43.323939 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b43119-ecf3-4f9b-b3c3-2d4acb521a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:43.324561 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b43119-ecf3-4f9b-b3c3-2d4acb521a76 service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:43.324841 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b43119-ecf3-4f9b-b3c3-2d4acb521a76 service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:43.325119 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b43119-ecf3-4f9b-b3c3-2d4acb521a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:43.333884 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b43119-ecf3-4f9b-b3c3-2d4acb521a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:43.335463 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b43119-ecf3-4f9b-b3c3-2d4acb521a76 service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:43.345025 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 506/1026] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:38:51.850926 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fb424-39b5-4322-a17c-6300834172cf None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:51.851476 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fb424-39b5-4322-a17c-6300834172cf None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:51.851476 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fb424-39b5-4322-a17c-6300834172cf None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:51.852766 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 521/1027] 10.222.0.61 () {54 vars in 918 bytes} [Sat Sep 24 20:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:51.857983 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd846378-24bf-44ca-8e99-3f3e22a3cd3b None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:51.858456 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd846378-24bf-44ca-8e99-3f3e22a3cd3b None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:51.858563 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd846378-24bf-44ca-8e99-3f3e22a3cd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:51.877632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-cd846378-24bf-44ca-8e99-3f3e22a3cd3b None None] MFA Rules not processed for user `d3060c5a247f495990fd7eec99c0ee0a`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:51.878827 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-cd846378-24bf-44ca-8e99-3f3e22a3cd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:51.890064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 507/1028] 10.222.0.61 () {58 vars in 1015 bytes} [Sat Sep 24 20:38:51 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:51.906279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f617940-db69-4b15-8dd6-550c9da77348 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:51.906660 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f617940-db69-4b15-8dd6-550c9da77348 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:51.907024 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f617940-db69-4b15-8dd6-550c9da77348 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:51.908451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 522/1029] 10.222.0.61 () {54 vars in 918 bytes} [Sat Sep 24 20:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:51.913196 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e7402-abd4-45a8-a138-17da4cadf54c None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:51.913731 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e7402-abd4-45a8-a138-17da4cadf54c None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:51.914005 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e7402-abd4-45a8-a138-17da4cadf54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:51.933299 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-ef3e7402-abd4-45a8-a138-17da4cadf54c None None] MFA Rules not processed for user `bc96ad30b91b46af92ff5b27a6b83abd`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:51.934478 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-ef3e7402-abd4-45a8-a138-17da4cadf54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:51.942743 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 508/1030] 10.222.0.61 () {58 vars in 1015 bytes} [Sat Sep 24 20:38:51 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:52.945064 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=20 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:38:54.748317 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d41d38-19ef-463c-8ce3-c10f180efdf5 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:54.748962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d41d38-19ef-463c-8ce3-c10f180efdf5 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:54.748962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d41d38-19ef-463c-8ce3-c10f180efdf5 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:54.750217 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 523/1031] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 20:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:54.755525 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da95398-2485-421a-86e2-beeb817e4ee5 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:54.755909 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da95398-2485-421a-86e2-beeb817e4ee5 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:54.756094 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da95398-2485-421a-86e2-beeb817e4ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:54.775961 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-2da95398-2485-421a-86e2-beeb817e4ee5 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:54.777182 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-2da95398-2485-421a-86e2-beeb817e4ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:54.784887 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 509/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 20:38:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:55.138732 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d41d38-19ef-463c-8ce3-c10f180efdf5 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:55.153251 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d41d38-19ef-463c-8ce3-c10f180efdf5 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:55.158173 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1efd78-fda1-40f4-8fe5-f635559a9b4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:55.158771 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1efd78-fda1-40f4-8fe5-f635559a9b4d service nova] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:55.159048 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1efd78-fda1-40f4-8fe5-f635559a9b4d service nova] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:55.159323 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1efd78-fda1-40f4-8fe5-f635559a9b4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:55.168768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1efd78-fda1-40f4-8fe5-f635559a9b4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:55.170339 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1efd78-fda1-40f4-8fe5-f635559a9b4d service nova] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:55.179548 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 524/1033] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:38:56.901703 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029b09d-d9e0-4a1b-803b-5dc5f0a82abf None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:56.902276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029b09d-d9e0-4a1b-803b-5dc5f0a82abf None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:56.902276 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029b09d-d9e0-4a1b-803b-5dc5f0a82abf None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:56.903568 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 510/1034] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 20:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:56.908361 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6523f-c31f-4c2d-a0fa-781b6a7a2d1f None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:56.908759 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6523f-c31f-4c2d-a0fa-781b6a7a2d1f None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:56.908914 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6523f-c31f-4c2d-a0fa-781b6a7a2d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:56.928931 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-49c6523f-c31f-4c2d-a0fa-781b6a7a2d1f None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:56.930175 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-49c6523f-c31f-4c2d-a0fa-781b6a7a2d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:56.938485 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 525/1035] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 20:38:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:57.160288 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029b09d-d9e0-4a1b-803b-5dc5f0a82abf None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:57.174625 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029b09d-d9e0-4a1b-803b-5dc5f0a82abf None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:57.179696 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d7cb1-9900-49b1-81ba-8499bb6c335f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:57.180294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d7cb1-9900-49b1-81ba-8499bb6c335f service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:57.180691 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d7cb1-9900-49b1-81ba-8499bb6c335f service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:57.181680 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d7cb1-9900-49b1-81ba-8499bb6c335f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:57.189827 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d7cb1-9900-49b1-81ba-8499bb6c335f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:57.191387 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d7cb1-9900-49b1-81ba-8499bb6c335f service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:57.200501 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 511/1036] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:38:58.896133 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5474b8-0c29-4841-8f62-0922e9e45f1b None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:58.896712 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5474b8-0c29-4841-8f62-0922e9e45f1b None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:58.896712 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5474b8-0c29-4841-8f62-0922e9e45f1b None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:58.898032 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 526/1037] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 20:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:38:58.903171 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d509be-b664-42ba-9aa6-48933cf3fd33 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:58.903588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d509be-b664-42ba-9aa6-48933cf3fd33 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:58.903732 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d509be-b664-42ba-9aa6-48933cf3fd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:58.923385 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-f8d509be-b664-42ba-9aa6-48933cf3fd33 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:38:58.924614 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-f8d509be-b664-42ba-9aa6-48933cf3fd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:38:58.933069 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 512/1038] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 20:38:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:38:59.089338 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5474b8-0c29-4841-8f62-0922e9e45f1b None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:38:59.103211 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5474b8-0c29-4841-8f62-0922e9e45f1b None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:38:59.108121 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4f87f-a12c-4e1d-a4c4-0705561959d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:38:59.108739 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4f87f-a12c-4e1d-a4c4-0705561959d4 service nova] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:38:59.109015 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4f87f-a12c-4e1d-a4c4-0705561959d4 service nova] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:38:59.109283 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4f87f-a12c-4e1d-a4c4-0705561959d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:38:59.117542 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4f87f-a12c-4e1d-a4c4-0705561959d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:38:59.119114 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4f87f-a12c-4e1d-a4c4-0705561959d4 service nova] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:38:59.128380 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 527/1039] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:38:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:00.794311 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33151-ffd3-4dae-83e4-069b7566b6b3 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:00.794887 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33151-ffd3-4dae-83e4-069b7566b6b3 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:00.794887 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33151-ffd3-4dae-83e4-069b7566b6b3 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:00.796186 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 513/1040] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 20:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:39:00.801248 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d0907-823b-4da5-a13e-d7048229dba4 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:00.801656 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d0907-823b-4da5-a13e-d7048229dba4 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:00.801806 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d0907-823b-4da5-a13e-d7048229dba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:00.820786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-889d0907-823b-4da5-a13e-d7048229dba4 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:39:00.822510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-889d0907-823b-4da5-a13e-d7048229dba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:39:00.830227 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 528/1041] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 20:39:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:39:00.989172 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f33151-ffd3-4dae-83e4-069b7566b6b3 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:39:01.002358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f33151-ffd3-4dae-83e4-069b7566b6b3 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:39:01.007190 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7c67b-21fd-4820-9883-8ac15e7c3128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:39:01.007775 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7c67b-21fd-4820-9883-8ac15e7c3128 service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:01.008050 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7c67b-21fd-4820-9883-8ac15e7c3128 service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:01.008321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7c67b-21fd-4820-9883-8ac15e7c3128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:01.016641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7c67b-21fd-4820-9883-8ac15e7c3128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:39:01.018192 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7c67b-21fd-4820-9883-8ac15e7c3128 service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:39:01.027835 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 514/1042] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:39:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:02.688659 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d85b2-dacf-449b-9548-cde31d69e0b2 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:02.689191 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d85b2-dacf-449b-9548-cde31d69e0b2 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:02.689191 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d85b2-dacf-449b-9548-cde31d69e0b2 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:02.690748 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 529/1043] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 20:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:39:02.695565 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74871190-88a1-4ba5-a2bf-7202e5b959d4 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:02.696549 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74871190-88a1-4ba5-a2bf-7202e5b959d4 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:02.696808 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74871190-88a1-4ba5-a2bf-7202e5b959d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:02.715727 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-74871190-88a1-4ba5-a2bf-7202e5b959d4 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:39:02.716936 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-74871190-88a1-4ba5-a2bf-7202e5b959d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:39:02.724529 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 515/1044] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 20:39:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:39:02.881478 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d85b2-dacf-449b-9548-cde31d69e0b2 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:39:02.895318 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d85b2-dacf-449b-9548-cde31d69e0b2 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:39:02.900303 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f40f8a-ff48-4c04-98b8-fbfe5667bfb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:39:02.900974 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f40f8a-ff48-4c04-98b8-fbfe5667bfb2 service nova] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:02.901249 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f40f8a-ff48-4c04-98b8-fbfe5667bfb2 service nova] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:02.901517 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f40f8a-ff48-4c04-98b8-fbfe5667bfb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:02.909391 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f40f8a-ff48-4c04-98b8-fbfe5667bfb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:39:02.910946 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f40f8a-ff48-4c04-98b8-fbfe5667bfb2 service nova] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:39:02.920838 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 530/1045] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:39:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:04.528325 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7f5e1-8475-4f13-9424-aa68c6462c44 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:04.528882 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7f5e1-8475-4f13-9424-aa68c6462c44 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:04.528882 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7f5e1-8475-4f13-9424-aa68c6462c44 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:04.530148 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 516/1046] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 20:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:39:04.535036 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a3f75-67ff-408c-8368-d918d13d109c None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:04.535467 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a3f75-67ff-408c-8368-d918d13d109c None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:04.535586 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a3f75-67ff-408c-8368-d918d13d109c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:04.555942 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-b80a3f75-67ff-408c-8368-d918d13d109c None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:39:04.557197 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-b80a3f75-67ff-408c-8368-d918d13d109c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:39:04.564831 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 531/1047] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 20:39:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:39:04.719554 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7f5e1-8475-4f13-9424-aa68c6462c44 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:39:04.733431 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7f5e1-8475-4f13-9424-aa68c6462c44 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:39:04.738333 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b4c9e-42ac-493d-962f-85e1925fc9ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:39:04.738917 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b4c9e-42ac-493d-962f-85e1925fc9ee service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:04.739198 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b4c9e-42ac-493d-962f-85e1925fc9ee service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:04.739470 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b4c9e-42ac-493d-962f-85e1925fc9ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:04.747959 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b4c9e-42ac-493d-962f-85e1925fc9ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:39:04.749544 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b4c9e-42ac-493d-962f-85e1925fc9ee service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:39:04.759314 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 517/1048] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:39:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:06.370574 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168bcfc-1a89-46ee-988a-58c237bf2b3d None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:06.371129 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168bcfc-1a89-46ee-988a-58c237bf2b3d None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:06.371247 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168bcfc-1a89-46ee-988a-58c237bf2b3d None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:06.372591 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 532/1049] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 20:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:39:06.377292 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322eaec-112c-40cb-89df-0170aa191627 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:06.377729 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322eaec-112c-40cb-89df-0170aa191627 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:06.377833 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322eaec-112c-40cb-89df-0170aa191627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:06.397103 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-9322eaec-112c-40cb-89df-0170aa191627 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:39:06.398413 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-9322eaec-112c-40cb-89df-0170aa191627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:39:06.406658 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 518/1050] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 20:39:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:39:06.565280 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168bcfc-1a89-46ee-988a-58c237bf2b3d None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:39:06.579202 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168bcfc-1a89-46ee-988a-58c237bf2b3d None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:39:06.584095 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601df61-8121-4fbb-a5b9-cf5072d0c04b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:39:06.584726 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601df61-8121-4fbb-a5b9-cf5072d0c04b service nova] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:06.585007 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601df61-8121-4fbb-a5b9-cf5072d0c04b service nova] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:06.585281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601df61-8121-4fbb-a5b9-cf5072d0c04b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:06.593316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601df61-8121-4fbb-a5b9-cf5072d0c04b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:39:06.594881 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601df61-8121-4fbb-a5b9-cf5072d0c04b service nova] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:39:06.603962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 533/1051] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:39:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:08.204916 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115724a5-cf08-4cf5-9e01-95b4fa686bd6 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:08.205379 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115724a5-cf08-4cf5-9e01-95b4fa686bd6 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:08.205499 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115724a5-cf08-4cf5-9e01-95b4fa686bd6 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:08.206806 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 519/1052] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 20:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:39:08.211810 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a553a-5e68-4388-8f2d-958f1eca7ba2 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:08.212263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a553a-5e68-4388-8f2d-958f1eca7ba2 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:08.212395 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a553a-5e68-4388-8f2d-958f1eca7ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:08.231943 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-9c1a553a-5e68-4388-8f2d-958f1eca7ba2 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:39:08.233164 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-9c1a553a-5e68-4388-8f2d-958f1eca7ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:39:08.240832 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 534/1053] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 20:39:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:39:08.396256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115724a5-cf08-4cf5-9e01-95b4fa686bd6 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:39:08.403564 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=67 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:39:08.410714 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115724a5-cf08-4cf5-9e01-95b4fa686bd6 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:39:08.416312 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81b9a2-9839-4966-bae5-32ba8b0e31be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:39:08.416989 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81b9a2-9839-4966-bae5-32ba8b0e31be service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:08.417208 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81b9a2-9839-4966-bae5-32ba8b0e31be service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:08.417481 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81b9a2-9839-4966-bae5-32ba8b0e31be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:08.425333 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81b9a2-9839-4966-bae5-32ba8b0e31be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:39:08.426882 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81b9a2-9839-4966-bae5-32ba8b0e31be service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:39:08.436560 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 520/1054] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:39:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:10.041565 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de810e6-1a24-4f01-9d74-bb37d7fa49d8 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:10.042123 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de810e6-1a24-4f01-9d74-bb37d7fa49d8 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:10.042123 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de810e6-1a24-4f01-9d74-bb37d7fa49d8 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:10.043433 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 535/1055] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 20:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:39:10.048241 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4b8c6-dc1f-4803-9baa-7433e524c3d0 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:10.048680 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4b8c6-dc1f-4803-9baa-7433e524c3d0 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:10.048818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4b8c6-dc1f-4803-9baa-7433e524c3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:10.068259 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-f4b4b8c6-dc1f-4803-9baa-7433e524c3d0 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:39:10.069472 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-f4b4b8c6-dc1f-4803-9baa-7433e524c3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:39:10.077813 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 521/1056] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 20:39:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:39:10.232666 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de810e6-1a24-4f01-9d74-bb37d7fa49d8 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:39:10.246705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de810e6-1a24-4f01-9d74-bb37d7fa49d8 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:39:10.251622 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ecc1d-136d-4d0e-9652-3919b24f068d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:39:10.252213 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ecc1d-136d-4d0e-9652-3919b24f068d service nova] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:10.252545 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ecc1d-136d-4d0e-9652-3919b24f068d service nova] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:10.252823 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ecc1d-136d-4d0e-9652-3919b24f068d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:10.261477 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ecc1d-136d-4d0e-9652-3919b24f068d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:39:10.263055 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ecc1d-136d-4d0e-9652-3919b24f068d service nova] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:39:10.272267 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 536/1057] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:39:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:12.674722 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adcc85-97b7-4bb9-82db-13f1da7968ca None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:12.675352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adcc85-97b7-4bb9-82db-13f1da7968ca None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:12.675352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adcc85-97b7-4bb9-82db-13f1da7968ca None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:12.676704 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 522/1058] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 20:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:39:12.682687 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad957533-f235-4bc6-8638-997651bb6e50 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:12.683116 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad957533-f235-4bc6-8638-997651bb6e50 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:12.683265 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad957533-f235-4bc6-8638-997651bb6e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:12.702283 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-ad957533-f235-4bc6-8638-997651bb6e50 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:39:12.703471 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-ad957533-f235-4bc6-8638-997651bb6e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:39:12.711208 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 537/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 20:39:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:39:13.063462 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adcc85-97b7-4bb9-82db-13f1da7968ca None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:39:13.080269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adcc85-97b7-4bb9-82db-13f1da7968ca None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:39:13.085867 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec7096-05ec-4777-9f5d-c41a7cbf6f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:39:13.087402 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec7096-05ec-4777-9f5d-c41a7cbf6f85 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:13.087906 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec7096-05ec-4777-9f5d-c41a7cbf6f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:13.088454 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec7096-05ec-4777-9f5d-c41a7cbf6f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:13.104515 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec7096-05ec-4777-9f5d-c41a7cbf6f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:39:13.105958 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec7096-05ec-4777-9f5d-c41a7cbf6f85 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:39:13.117810 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 523/1060] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:39:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:15.712051 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6e667-2045-4115-ba17-b6dd1ee00364 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:15.712651 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6e667-2045-4115-ba17-b6dd1ee00364 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:15.712651 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff6e667-2045-4115-ba17-b6dd1ee00364 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:15.714003 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 538/1061] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 20:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:39:15.719203 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44492388-f88a-4bfd-91f2-f8299a0ccb4c None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:15.719632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44492388-f88a-4bfd-91f2-f8299a0ccb4c None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:15.719739 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44492388-f88a-4bfd-91f2-f8299a0ccb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:15.738553 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-44492388-f88a-4bfd-91f2-f8299a0ccb4c None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:39:15.739758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-44492388-f88a-4bfd-91f2-f8299a0ccb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:39:15.747617 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 524/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 20:39:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:39:16.083355 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6e667-2045-4115-ba17-b6dd1ee00364 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:39:16.094072 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff6e667-2045-4115-ba17-b6dd1ee00364 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:39:16.097606 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085bf8f-9f28-4d88-9b77-852acaeca33b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:39:16.098194 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085bf8f-9f28-4d88-9b77-852acaeca33b service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:16.098476 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085bf8f-9f28-4d88-9b77-852acaeca33b service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:16.098758 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085bf8f-9f28-4d88-9b77-852acaeca33b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:16.107572 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085bf8f-9f28-4d88-9b77-852acaeca33b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:39:16.109030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085bf8f-9f28-4d88-9b77-852acaeca33b service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:39:16.118720 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 539/1063] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:39:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:18.825254 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892c499-ac4e-4db8-98b0-013ba082d71a None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:18.825796 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892c499-ac4e-4db8-98b0-013ba082d71a None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:18.825796 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892c499-ac4e-4db8-98b0-013ba082d71a None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:18.827129 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 525/1064] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 20:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:39:18.832316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913663a-5069-4b5f-82d6-7a4e6a9a20d0 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:18.832787 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913663a-5069-4b5f-82d6-7a4e6a9a20d0 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:18.832948 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913663a-5069-4b5f-82d6-7a4e6a9a20d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:18.855236 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-7913663a-5069-4b5f-82d6-7a4e6a9a20d0 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:39:18.856509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-7913663a-5069-4b5f-82d6-7a4e6a9a20d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:39:18.866606 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 540/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 20:39:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:39:19.200133 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892c499-ac4e-4db8-98b0-013ba082d71a None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:39:19.210812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892c499-ac4e-4db8-98b0-013ba082d71a None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:39:19.214363 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4013b-e1d9-4505-8a75-597b9078aa8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:39:19.214957 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4013b-e1d9-4505-8a75-597b9078aa8e service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:19.215238 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4013b-e1d9-4505-8a75-597b9078aa8e service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:19.215516 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4013b-e1d9-4505-8a75-597b9078aa8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:19.227347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4013b-e1d9-4505-8a75-597b9078aa8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:39:19.229986 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4013b-e1d9-4505-8a75-597b9078aa8e service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:39:19.241231 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 526/1066] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:39:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:21.745227 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c631fd8-bdca-40a2-b668-2788a09cc586 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:21.745739 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c631fd8-bdca-40a2-b668-2788a09cc586 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:21.745739 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c631fd8-bdca-40a2-b668-2788a09cc586 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:21.747091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 541/1067] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 20:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:39:21.752417 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffa28e-b8f1-42bd-b30b-9ca448c8c746 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:21.752821 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffa28e-b8f1-42bd-b30b-9ca448c8c746 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:21.752971 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffa28e-b8f1-42bd-b30b-9ca448c8c746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:21.772278 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-d8ffa28e-b8f1-42bd-b30b-9ca448c8c746 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:39:21.774116 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-d8ffa28e-b8f1-42bd-b30b-9ca448c8c746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:39:21.781677 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 527/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 20:39:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:39:22.122149 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c631fd8-bdca-40a2-b668-2788a09cc586 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:39:22.133629 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c631fd8-bdca-40a2-b668-2788a09cc586 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:39:22.137155 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ee074-7c8c-41f5-9e9f-0b5be7ca2295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:39:22.137745 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ee074-7c8c-41f5-9e9f-0b5be7ca2295 service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:22.138026 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ee074-7c8c-41f5-9e9f-0b5be7ca2295 service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:22.138297 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ee074-7c8c-41f5-9e9f-0b5be7ca2295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:22.146918 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ee074-7c8c-41f5-9e9f-0b5be7ca2295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:39:22.148398 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ee074-7c8c-41f5-9e9f-0b5be7ca2295 service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:39:22.157554 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 542/1069] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:39:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:24.609976 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eadf5c-63fe-43de-83e2-b4fa9555128b None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:24.610548 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eadf5c-63fe-43de-83e2-b4fa9555128b None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:24.610548 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eadf5c-63fe-43de-83e2-b4fa9555128b None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:24.611849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 528/1070] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 20:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:39:24.617346 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6919c5-4db0-4c02-8020-c46b07bb4fbf None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:24.617778 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6919c5-4db0-4c02-8020-c46b07bb4fbf None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:24.617895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6919c5-4db0-4c02-8020-c46b07bb4fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:24.625234 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=61 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:39:24.637815 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-de6919c5-4db0-4c02-8020-c46b07bb4fbf None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:39:24.639010 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-de6919c5-4db0-4c02-8020-c46b07bb4fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:39:24.646725 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 543/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 20:39:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:39:24.981366 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eadf5c-63fe-43de-83e2-b4fa9555128b None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:39:24.992494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eadf5c-63fe-43de-83e2-b4fa9555128b None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:39:24.996250 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f22e8-fa3b-407c-82bf-4a4486562692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:39:24.996863 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f22e8-fa3b-407c-82bf-4a4486562692 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:24.997151 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f22e8-fa3b-407c-82bf-4a4486562692 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:24.997423 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f22e8-fa3b-407c-82bf-4a4486562692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:25.006007 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f22e8-fa3b-407c-82bf-4a4486562692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:39:25.007406 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f22e8-fa3b-407c-82bf-4a4486562692 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:39:25.016562 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 529/1072] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:39:24 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:27.454224 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91ba3a-bca0-43a7-933a-f93b4279660f None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:27.454813 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91ba3a-bca0-43a7-933a-f93b4279660f None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:27.454813 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91ba3a-bca0-43a7-933a-f93b4279660f None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:27.456107 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 544/1073] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 20:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:39:27.461935 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bdd1a-4a2d-4350-8993-bf0c93b14785 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:27.462361 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bdd1a-4a2d-4350-8993-bf0c93b14785 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:27.462464 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bdd1a-4a2d-4350-8993-bf0c93b14785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:27.481660 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-582bdd1a-4a2d-4350-8993-bf0c93b14785 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:39:27.482834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-582bdd1a-4a2d-4350-8993-bf0c93b14785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:39:27.490436 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 530/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 20:39:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:39:27.825318 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91ba3a-bca0-43a7-933a-f93b4279660f None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:39:27.836512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91ba3a-bca0-43a7-933a-f93b4279660f None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:39:27.840000 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee485f1-ebdf-4cda-bc7b-664c913600f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:39:27.840631 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee485f1-ebdf-4cda-bc7b-664c913600f1 service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:27.840909 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee485f1-ebdf-4cda-bc7b-664c913600f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:27.841183 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee485f1-ebdf-4cda-bc7b-664c913600f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:27.850016 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee485f1-ebdf-4cda-bc7b-664c913600f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:39:27.851467 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee485f1-ebdf-4cda-bc7b-664c913600f1 service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:39:27.860668 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 545/1075] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:39:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:30.279464 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b91696-08dd-4027-b81d-f0025a245b0f None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:30.279987 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b91696-08dd-4027-b81d-f0025a245b0f None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:30.279987 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b91696-08dd-4027-b81d-f0025a245b0f None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:30.281334 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 531/1076] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 20:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:39:30.286455 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c158e-e573-48d1-ac68-9c5ed0014903 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:30.286890 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c158e-e573-48d1-ac68-9c5ed0014903 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:30.287027 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c158e-e573-48d1-ac68-9c5ed0014903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:30.306765 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-110c158e-e573-48d1-ac68-9c5ed0014903 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:39:30.307975 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-110c158e-e573-48d1-ac68-9c5ed0014903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:39:30.315655 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 546/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 20:39:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:39:30.652580 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b91696-08dd-4027-b81d-f0025a245b0f None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:39:30.664585 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b91696-08dd-4027-b81d-f0025a245b0f None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:39:30.668035 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb5f06-a3f0-4243-94c6-3cfd53b71bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:39:30.668657 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb5f06-a3f0-4243-94c6-3cfd53b71bcb service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:30.668936 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb5f06-a3f0-4243-94c6-3cfd53b71bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:30.669213 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb5f06-a3f0-4243-94c6-3cfd53b71bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:30.677896 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb5f06-a3f0-4243-94c6-3cfd53b71bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:39:30.680057 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb5f06-a3f0-4243-94c6-3cfd53b71bcb service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:39:30.689114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 532/1078] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:39:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:33.163229 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d7c3f-6be3-480f-ab26-2072c10c2631 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:33.164415 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d7c3f-6be3-480f-ab26-2072c10c2631 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:33.164514 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d7c3f-6be3-480f-ab26-2072c10c2631 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:33.165927 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 547/1079] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 20:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:39:33.171470 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4df0d9-dfd4-46a5-aa0f-1ba8249d7897 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:33.171924 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4df0d9-dfd4-46a5-aa0f-1ba8249d7897 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:33.172029 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4df0d9-dfd4-46a5-aa0f-1ba8249d7897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:33.191633 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-1f4df0d9-dfd4-46a5-aa0f-1ba8249d7897 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:39:33.192876 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-1f4df0d9-dfd4-46a5-aa0f-1ba8249d7897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:39:33.200727 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 533/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 20:39:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:39:33.541525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d7c3f-6be3-480f-ab26-2072c10c2631 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:39:33.552275 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d7c3f-6be3-480f-ab26-2072c10c2631 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:39:33.555850 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09a714-cf44-455a-89c6-f17554171174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:39:33.556473 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09a714-cf44-455a-89c6-f17554171174 service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:33.556758 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09a714-cf44-455a-89c6-f17554171174 service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:33.557036 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09a714-cf44-455a-89c6-f17554171174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:33.565806 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09a714-cf44-455a-89c6-f17554171174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:39:33.567233 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09a714-cf44-455a-89c6-f17554171174 service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:39:33.576449 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 548/1081] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:39:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:36.072998 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded469bb-74c5-4e13-a6ae-923a26e76ecd None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:36.073547 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded469bb-74c5-4e13-a6ae-923a26e76ecd None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:36.073547 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded469bb-74c5-4e13-a6ae-923a26e76ecd None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:36.074863 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 534/1082] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 20:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:39:36.080175 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f3020-2a08-4dae-b85b-ee5fd508217b None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:36.080615 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f3020-2a08-4dae-b85b-ee5fd508217b None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:36.080777 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f3020-2a08-4dae-b85b-ee5fd508217b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:36.099628 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-603f3020-2a08-4dae-b85b-ee5fd508217b None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:39:36.101299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-603f3020-2a08-4dae-b85b-ee5fd508217b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:39:36.109042 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 549/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 20:39:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:39:36.457806 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded469bb-74c5-4e13-a6ae-923a26e76ecd None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:39:36.469046 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded469bb-74c5-4e13-a6ae-923a26e76ecd None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:39:36.472602 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39800497-d445-458d-b8a8-63bdae084a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:39:36.473192 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39800497-d445-458d-b8a8-63bdae084a79 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:36.473470 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39800497-d445-458d-b8a8-63bdae084a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:36.473745 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39800497-d445-458d-b8a8-63bdae084a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:36.483126 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39800497-d445-458d-b8a8-63bdae084a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:39:36.484567 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39800497-d445-458d-b8a8-63bdae084a79 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:39:36.493733 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 535/1084] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:39:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:38.891525 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c297cb-c0fa-4602-a330-2705e262e49d None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:38.892104 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c297cb-c0fa-4602-a330-2705e262e49d None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:38.892384 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c297cb-c0fa-4602-a330-2705e262e49d None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:38.893833 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 550/1085] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 20:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:39:38.899841 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6a894-ac2d-48fe-9aae-7960175879b5 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:38.900306 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6a894-ac2d-48fe-9aae-7960175879b5 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:38.900541 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6a894-ac2d-48fe-9aae-7960175879b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:38.908029 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=51 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:39:38.921733 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-aaf6a894-ac2d-48fe-9aae-7960175879b5 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:39:38.922927 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-aaf6a894-ac2d-48fe-9aae-7960175879b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:39:38.931705 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 536/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 20:39:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:39:39.268202 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c297cb-c0fa-4602-a330-2705e262e49d None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:39:39.279274 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c297cb-c0fa-4602-a330-2705e262e49d None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:39:39.282727 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d9287-3f4f-48b1-b4b2-f894f7d37351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:39:39.283308 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d9287-3f4f-48b1-b4b2-f894f7d37351 service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:39:39.283585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d9287-3f4f-48b1-b4b2-f894f7d37351 service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:39:39.283854 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d9287-3f4f-48b1-b4b2-f894f7d37351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:39:39.293411 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d9287-3f4f-48b1-b4b2-f894f7d37351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:39:39.294829 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d9287-3f4f-48b1-b4b2-f894f7d37351 service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:39:39.303852 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 551/1087] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:39:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:39:48.916792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=2 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:39:49.299923 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=26 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:40:03.675193 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01385d75-462b-44ef-8f06-d7c6a806aed8 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:03.675727 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01385d75-462b-44ef-8f06-d7c6a806aed8 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:03.675727 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01385d75-462b-44ef-8f06-d7c6a806aed8 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:03.677101 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 537/1088] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:40:03.684476 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afa2e2-e76d-4ff4-9fcd-eaf88f13c082 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:03.684893 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afa2e2-e76d-4ff4-9fcd-eaf88f13c082 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:03.685031 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afa2e2-e76d-4ff4-9fcd-eaf88f13c082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:03.703938 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-99afa2e2-e76d-4ff4-9fcd-eaf88f13c082 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:40:03.705172 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-99afa2e2-e76d-4ff4-9fcd-eaf88f13c082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:40:03.712888 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 552/1089] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:40:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:40:04.065318 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249a74e-b93d-46d0-a666-f9a86515393e None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:04.065608 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249a74e-b93d-46d0-a666-f9a86515393e None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:04.065887 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249a74e-b93d-46d0-a666-f9a86515393e None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:04.067192 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 538/1090] 10.222.0.61 () {54 vars in 962 bytes} [Sat Sep 24 20:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:40:04.072719 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c497-dbbf-4268-8ef7-013833cc2d18 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:04.073011 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c497-dbbf-4268-8ef7-013833cc2d18 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:04.073290 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51c497-dbbf-4268-8ef7-013833cc2d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:04.092965 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-df51c497-dbbf-4268-8ef7-013833cc2d18 None None] MFA Rules not processed for user `b505bdb933aa4bffa870851e4cb87c59`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:40:04.094158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-df51c497-dbbf-4268-8ef7-013833cc2d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:40:04.101803 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 553/1091] 10.222.0.61 () {58 vars in 1059 bytes} [Sat Sep 24 20:40:04 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:40:04.109274 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249a74e-b93d-46d0-a666-f9a86515393e None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:40:04.119661 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249a74e-b93d-46d0-a666-f9a86515393e None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:40:04.123230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f1388-0a74-4d79-a1a9-bdc7d4c40a56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b505bdb933aa4bffa870851e4cb87c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:40:04.123810 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f1388-0a74-4d79-a1a9-bdc7d4c40a56 service glance] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:04.124097 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f1388-0a74-4d79-a1a9-bdc7d4c40a56 service glance] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:04.124397 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f1388-0a74-4d79-a1a9-bdc7d4c40a56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:04.133150 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f1388-0a74-4d79-a1a9-bdc7d4c40a56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:40:04.134553 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f1388-0a74-4d79-a1a9-bdc7d4c40a56 service glance] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:40:04.143737 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 539/1092] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:40:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:40:06.621640 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecbeb6-4946-4b79-8512-fc3fd586a844 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:06.622206 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecbeb6-4946-4b79-8512-fc3fd586a844 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:06.622206 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecbeb6-4946-4b79-8512-fc3fd586a844 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:06.623522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 554/1093] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:40:06.628724 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b75e06-85be-4508-9598-191198162c07 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:06.629176 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b75e06-85be-4508-9598-191198162c07 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:06.629283 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b75e06-85be-4508-9598-191198162c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:06.648670 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-f7b75e06-85be-4508-9598-191198162c07 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:40:06.649857 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-f7b75e06-85be-4508-9598-191198162c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:40:06.657488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 540/1094] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:40:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:40:06.984671 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecbeb6-4946-4b79-8512-fc3fd586a844 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:40:06.998019 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecbeb6-4946-4b79-8512-fc3fd586a844 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:40:07.002361 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6953d-84aa-47fd-b7f6-eba8162659a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:40:07.002945 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6953d-84aa-47fd-b7f6-eba8162659a2 admin admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:07.003223 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6953d-84aa-47fd-b7f6-eba8162659a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:07.003514 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6953d-84aa-47fd-b7f6-eba8162659a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:07.004123 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6953d-84aa-47fd-b7f6-eba8162659a2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:40:07.006078 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: WARNING py.warnings [None req-bba6953d-84aa-47fd-b7f6-eba8162659a2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 20:40:07.006078 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: warnings.warn(msg) Sep 24 20:40:07.006078 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: Sep 24 20:40:07.007203 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6953d-84aa-47fd-b7f6-eba8162659a2 admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:40:07.025727 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 555/1095] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Sep 24 20:40:06 2022] GET /identity/v3/projects => generated 1606 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:40:09.444253 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2135d-659c-4dee-894c-719abccc01e9 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:09.444805 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2135d-659c-4dee-894c-719abccc01e9 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:09.444805 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2135d-659c-4dee-894c-719abccc01e9 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:09.446714 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 541/1096] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:40:09.451991 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a57a3-818a-4b54-99d2-3ee464f12629 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:09.452429 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a57a3-818a-4b54-99d2-3ee464f12629 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:09.452590 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a57a3-818a-4b54-99d2-3ee464f12629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:09.471561 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-825a57a3-818a-4b54-99d2-3ee464f12629 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:40:09.472789 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-825a57a3-818a-4b54-99d2-3ee464f12629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:40:09.480527 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 556/1097] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:40:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:40:09.823860 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2135d-659c-4dee-894c-719abccc01e9 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:40:09.838397 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2135d-659c-4dee-894c-719abccc01e9 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:40:09.843304 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b5ed1-9de7-447c-9a1c-95329890bfbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:40:09.843904 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b5ed1-9de7-447c-9a1c-95329890bfbb service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:09.844188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b5ed1-9de7-447c-9a1c-95329890bfbb service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:09.844508 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b5ed1-9de7-447c-9a1c-95329890bfbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:09.852634 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b5ed1-9de7-447c-9a1c-95329890bfbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:40:09.854193 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b5ed1-9de7-447c-9a1c-95329890bfbb service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:40:09.863352 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 542/1098] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:40:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:40:12.448684 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09708ea-fad0-4ee4-bd8c-2984f1457a8b None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:12.449211 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09708ea-fad0-4ee4-bd8c-2984f1457a8b None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:12.449211 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09708ea-fad0-4ee4-bd8c-2984f1457a8b None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:12.450550 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 557/1099] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:40:12.455667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466a93-537b-48b8-8e83-b541a9e5f081 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:12.456046 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466a93-537b-48b8-8e83-b541a9e5f081 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:12.456220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11466a93-537b-48b8-8e83-b541a9e5f081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:12.476080 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-11466a93-537b-48b8-8e83-b541a9e5f081 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:40:12.477299 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-11466a93-537b-48b8-8e83-b541a9e5f081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:40:12.484865 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 543/1100] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:40:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:40:12.821231 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09708ea-fad0-4ee4-bd8c-2984f1457a8b None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:40:12.832012 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09708ea-fad0-4ee4-bd8c-2984f1457a8b None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:40:12.836140 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f4b51-45ce-4128-bb46-cb1fe31acecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:40:12.836772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f4b51-45ce-4128-bb46-cb1fe31acecd service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:12.837053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f4b51-45ce-4128-bb46-cb1fe31acecd service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:12.837324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f4b51-45ce-4128-bb46-cb1fe31acecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:12.846372 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f4b51-45ce-4128-bb46-cb1fe31acecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:40:12.847792 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21f4b51-45ce-4128-bb46-cb1fe31acecd service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:40:12.857030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 558/1101] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:40:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:40:15.321532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012bfd3-ab22-4812-86f6-3f7f618db198 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:15.322115 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012bfd3-ab22-4812-86f6-3f7f618db198 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:15.322115 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012bfd3-ab22-4812-86f6-3f7f618db198 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:15.323387 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 544/1102] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:40:15.328577 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626599e-cc8c-42eb-9e22-c5ffddf9645f None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:15.329017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626599e-cc8c-42eb-9e22-c5ffddf9645f None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:15.329126 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626599e-cc8c-42eb-9e22-c5ffddf9645f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:15.348727 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-7626599e-cc8c-42eb-9e22-c5ffddf9645f None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:40:15.350428 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-7626599e-cc8c-42eb-9e22-c5ffddf9645f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:40:15.358208 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 559/1103] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:40:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:40:15.714662 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012bfd3-ab22-4812-86f6-3f7f618db198 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:40:15.725463 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012bfd3-ab22-4812-86f6-3f7f618db198 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:40:15.728998 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975791d-60b4-484f-8222-93bc37e91fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:40:15.729590 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975791d-60b4-484f-8222-93bc37e91fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:15.729870 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975791d-60b4-484f-8222-93bc37e91fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:15.730145 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975791d-60b4-484f-8222-93bc37e91fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:15.738797 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975791d-60b4-484f-8222-93bc37e91fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:40:15.740220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975791d-60b4-484f-8222-93bc37e91fb9 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:40:15.749585 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 545/1104] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:40:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:40:18.221843 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae15da4-983d-412e-bef7-ab5256dec682 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:18.222356 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae15da4-983d-412e-bef7-ab5256dec682 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:18.222356 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae15da4-983d-412e-bef7-ab5256dec682 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:18.224272 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 560/1105] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:40:18.229339 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782d101-62eb-42ca-a206-a2ec3033ad68 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:18.229768 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782d101-62eb-42ca-a206-a2ec3033ad68 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:18.229882 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782d101-62eb-42ca-a206-a2ec3033ad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:18.250438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-f782d101-62eb-42ca-a206-a2ec3033ad68 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:40:18.251753 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-f782d101-62eb-42ca-a206-a2ec3033ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:40:18.259726 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 546/1106] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:40:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:40:18.610029 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae15da4-983d-412e-bef7-ab5256dec682 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:40:18.620557 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae15da4-983d-412e-bef7-ab5256dec682 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:40:18.623983 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25428b-6f4f-4098-96d7-5b976344b0fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:40:18.624596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25428b-6f4f-4098-96d7-5b976344b0fc service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:18.624875 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25428b-6f4f-4098-96d7-5b976344b0fc service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:18.625147 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25428b-6f4f-4098-96d7-5b976344b0fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:18.633785 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25428b-6f4f-4098-96d7-5b976344b0fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:40:18.635202 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25428b-6f4f-4098-96d7-5b976344b0fc service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:40:18.644327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 561/1107] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:40:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:40:21.370485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3bb3f-fe04-436e-bffb-617e33563197 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:21.371061 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3bb3f-fe04-436e-bffb-617e33563197 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:21.371061 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3bb3f-fe04-436e-bffb-617e33563197 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:21.372348 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 547/1108] 10.222.0.61 () {54 vars in 927 bytes} [Sat Sep 24 20:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:40:21.377479 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b1a3e-9cdf-4a5d-920f-4afbeb9811a7 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:21.377916 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b1a3e-9cdf-4a5d-920f-4afbeb9811a7 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:21.378026 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b1a3e-9cdf-4a5d-920f-4afbeb9811a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:21.397341 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-0e7b1a3e-9cdf-4a5d-920f-4afbeb9811a7 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:40:21.398523 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-0e7b1a3e-9cdf-4a5d-920f-4afbeb9811a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:40:21.406104 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 562/1109] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Sep 24 20:40:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:40:21.743206 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3bb3f-fe04-436e-bffb-617e33563197 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:40:21.753646 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3bb3f-fe04-436e-bffb-617e33563197 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:40:21.757172 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135f7f2-19f2-4eb8-aca1-7c23dd7a5b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:40:21.757696 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135f7f2-19f2-4eb8-aca1-7c23dd7a5b63 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:40:21.757972 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135f7f2-19f2-4eb8-aca1-7c23dd7a5b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:40:21.758242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135f7f2-19f2-4eb8-aca1-7c23dd7a5b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:40:21.766669 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135f7f2-19f2-4eb8-aca1-7c23dd7a5b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:40:21.768067 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135f7f2-19f2-4eb8-aca1-7c23dd7a5b63 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:40:21.777307 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 548/1110] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:40:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:40:31.392610 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=33 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:40:31.773155 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=33 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:42:00.244949 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402e46a-7545-4c99-9e16-a0385a987677 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:00.245567 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402e46a-7545-4c99-9e16-a0385a987677 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:00.245567 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402e46a-7545-4c99-9e16-a0385a987677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:00.319810 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-b402e46a-7545-4c99-9e16-a0385a987677 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:42:00.320948 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-b402e46a-7545-4c99-9e16-a0385a987677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:42:00.361972 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 563/1111] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:42:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:42:00.369839 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6208eba-fbba-4068-a721-574c21f0ee6f None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:00.370359 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6208eba-fbba-4068-a721-574c21f0ee6f None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:00.370459 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6208eba-fbba-4068-a721-574c21f0ee6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:00.389969 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-c6208eba-fbba-4068-a721-574c21f0ee6f None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:42:00.391210 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-c6208eba-fbba-4068-a721-574c21f0ee6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:42:00.398883 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 549/1112] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:42:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:42:00.403306 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402e46a-7545-4c99-9e16-a0385a987677 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:42:00.413053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402e46a-7545-4c99-9e16-a0385a987677 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:42:00.417461 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627c1d3-dd4a-4646-8c18-705aeb40eb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:42:00.418050 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627c1d3-dd4a-4646-8c18-705aeb40eb34 admin admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:00.418327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627c1d3-dd4a-4646-8c18-705aeb40eb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:00.418597 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627c1d3-dd4a-4646-8c18-705aeb40eb34 admin admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:00.419266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627c1d3-dd4a-4646-8c18-705aeb40eb34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:42:00.419566 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627c1d3-dd4a-4646-8c18-705aeb40eb34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:42:00.420598 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: WARNING py.warnings [None req-4627c1d3-dd4a-4646-8c18-705aeb40eb34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 20:42:00.420598 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: warnings.warn(msg) Sep 24 20:42:00.420598 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: Sep 24 20:42:00.421475 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627c1d3-dd4a-4646-8c18-705aeb40eb34 admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:42:00.433819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 564/1113] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Sep 24 20:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:42:00.442743 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6208eba-fbba-4068-a721-574c21f0ee6f None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:42:00.451794 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6208eba-fbba-4068-a721-574c21f0ee6f None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:42:00.456394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ef1e2-110c-4483-82b8-cb1109c8ae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:42:00.456980 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ef1e2-110c-4483-82b8-cb1109c8ae43 admin admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:00.457260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ef1e2-110c-4483-82b8-cb1109c8ae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:00.457534 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ef1e2-110c-4483-82b8-cb1109c8ae43 admin admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:00.458157 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ef1e2-110c-4483-82b8-cb1109c8ae43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:42:00.459857 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: WARNING py.warnings [None req-776ef1e2-110c-4483-82b8-cb1109c8ae43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 20:42:00.459857 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: warnings.warn(msg) Sep 24 20:42:00.459857 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: Sep 24 20:42:00.461080 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ef1e2-110c-4483-82b8-cb1109c8ae43 admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:42:00.497201 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 550/1114] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Sep 24 20:42:00 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:42:00.501832 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627c1d3-dd4a-4646-8c18-705aeb40eb34 admin admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:42:00.511698 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627c1d3-dd4a-4646-8c18-705aeb40eb34 admin admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:42:00.568824 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dee39-72f3-42be-adbb-e4af2d25fe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:42:00.569428 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dee39-72f3-42be-adbb-e4af2d25fe7b admin admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:00.569707 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dee39-72f3-42be-adbb-e4af2d25fe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:00.570029 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dee39-72f3-42be-adbb-e4af2d25fe7b admin admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:00.570588 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dee39-72f3-42be-adbb-e4af2d25fe7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:42:00.571590 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: WARNING py.warnings [None req-593dee39-72f3-42be-adbb-e4af2d25fe7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 20:42:00.571590 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: warnings.warn(msg) Sep 24 20:42:00.571590 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: Sep 24 20:42:00.572820 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dee39-72f3-42be-adbb-e4af2d25fe7b admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:42:00.594536 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 565/1115] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Sep 24 20:42:00 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:42:00.598808 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ef1e2-110c-4483-82b8-cb1109c8ae43 admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:42:00.608849 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ef1e2-110c-4483-82b8-cb1109c8ae43 admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:42:00.613439 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf83c1-70ca-4ef9-b517-9c2d66f9873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:42:00.614034 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf83c1-70ca-4ef9-b517-9c2d66f9873b admin admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:00.614314 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf83c1-70ca-4ef9-b517-9c2d66f9873b admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:00.614588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf83c1-70ca-4ef9-b517-9c2d66f9873b admin admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:00.615220 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf83c1-70ca-4ef9-b517-9c2d66f9873b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:42:00.616224 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: WARNING py.warnings [None req-bcaf83c1-70ca-4ef9-b517-9c2d66f9873b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 20:42:00.616224 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: warnings.warn(msg) Sep 24 20:42:00.616224 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: Sep 24 20:42:00.617150 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf83c1-70ca-4ef9-b517-9c2d66f9873b admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:42:00.629614 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 551/1116] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Sep 24 20:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:42:00.633561 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dee39-72f3-42be-adbb-e4af2d25fe7b admin admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:42:00.644019 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dee39-72f3-42be-adbb-e4af2d25fe7b admin admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:42:00.648895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f72fdd-dbc7-427d-90bb-daefe38fc17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:42:00.649571 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f72fdd-dbc7-427d-90bb-daefe38fc17c admin admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:00.649853 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f72fdd-dbc7-427d-90bb-daefe38fc17c admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:00.650128 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f72fdd-dbc7-427d-90bb-daefe38fc17c admin admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:00.650759 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f72fdd-dbc7-427d-90bb-daefe38fc17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:42:00.651756 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: WARNING py.warnings [None req-80f72fdd-dbc7-427d-90bb-daefe38fc17c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 20:42:00.651756 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: warnings.warn(msg) Sep 24 20:42:00.651756 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: Sep 24 20:42:00.652660 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f72fdd-dbc7-427d-90bb-daefe38fc17c admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:42:00.666589 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 566/1117] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Sep 24 20:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:42:00.670812 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf83c1-70ca-4ef9-b517-9c2d66f9873b admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:42:00.680720 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf83c1-70ca-4ef9-b517-9c2d66f9873b admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:42:00.685293 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6958cca-57e6-4595-8ca8-58368b0e3b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:42:00.685933 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958cca-57e6-4595-8ca8-58368b0e3b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:00.686218 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958cca-57e6-4595-8ca8-58368b0e3b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:00.686560 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6958cca-57e6-4595-8ca8-58368b0e3b83 admin admin] PATH_INFO: `/v3/projects/1a37587dc8004989bd8a4743730cc49a/users/58b50195fadf48a28dde42d0a9a010cd/roles/3481273c76dc4a20b3f73c4f8ea558e6` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:00.701264 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6958cca-57e6-4595-8ca8-58368b0e3b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a37587dc8004989bd8a4743730cc49a, user_id=58b50195fadf48a28dde42d0a9a010cd, role_id=3481273c76dc4a20b3f73c4f8ea558e6)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:42:00.702283 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: WARNING py.warnings [None req-c6958cca-57e6-4595-8ca8-58368b0e3b83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 20:42:00.702283 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: warnings.warn(msg) Sep 24 20:42:00.702283 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: Sep 24 20:42:00.704904 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6958cca-57e6-4595-8ca8-58368b0e3b83 admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:42:00.718238 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 552/1118] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Sep 24 20:42:00 2022] PUT /identity/v3/projects/1a37587dc8004989bd8a4743730cc49a/users/58b50195fadf48a28dde42d0a9a010cd/roles/3481273c76dc4a20b3f73c4f8ea558e6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:42:00.730207 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb43ebf-2ba7-4de8-a328-f02fbd4c9c12 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:00.730489 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb43ebf-2ba7-4de8-a328-f02fbd4c9c12 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:00.730762 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb43ebf-2ba7-4de8-a328-f02fbd4c9c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:00.758388 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-0bb43ebf-2ba7-4de8-a328-f02fbd4c9c12 None None] MFA Rules not processed for user `58b50195fadf48a28dde42d0a9a010cd`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:42:00.759582 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-0bb43ebf-2ba7-4de8-a328-f02fbd4c9c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:42:00.792327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:42:00.824712 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 567/1119] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:42:00 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:42:00.838262 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90355e7f-2043-49a5-b8d5-5e33170b3204 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:00.838548 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90355e7f-2043-49a5-b8d5-5e33170b3204 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:00.838825 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90355e7f-2043-49a5-b8d5-5e33170b3204 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:00.840121 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 553/1120] 10.222.0.61 () {54 vars in 963 bytes} [Sat Sep 24 20:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:42:00.845169 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41609f2-fecb-49e2-86d9-a14b7ff91b2f None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:00.845456 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41609f2-fecb-49e2-86d9-a14b7ff91b2f None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:00.845730 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41609f2-fecb-49e2-86d9-a14b7ff91b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:00.866065 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-e41609f2-fecb-49e2-86d9-a14b7ff91b2f None None] MFA Rules not processed for user `9e6e1fa10cb9487d8b346800e360c7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:42:00.867252 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-e41609f2-fecb-49e2-86d9-a14b7ff91b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:42:00.916859 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 568/1121] 10.222.0.61 () {58 vars in 1060 bytes} [Sat Sep 24 20:42:00 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:42:00.924613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90355e7f-2043-49a5-b8d5-5e33170b3204 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:42:00.934915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90355e7f-2043-49a5-b8d5-5e33170b3204 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:42:00.939021 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf77015-95a5-41e9-9f33-1a755274d238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6e1fa10cb9487d8b346800e360c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:42:00.939596 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf77015-95a5-41e9-9f33-1a755274d238 service cinder] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:00.939873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf77015-95a5-41e9-9f33-1a755274d238 service cinder] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:00.940141 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf77015-95a5-41e9-9f33-1a755274d238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:00.948519 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf77015-95a5-41e9-9f33-1a755274d238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:42:00.949956 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf77015-95a5-41e9-9f33-1a755274d238 service cinder] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:42:00.959056 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 554/1122] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:42:00 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:42:00.996163 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077a5d-5f3b-4ef6-bfe9-13b424e52084 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:00.996497 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077a5d-5f3b-4ef6-bfe9-13b424e52084 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:00.996781 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077a5d-5f3b-4ef6-bfe9-13b424e52084 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:00.998047 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 569/1123] 10.222.0.61 () {52 vars in 830 bytes} [Sat Sep 24 20:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:42:01.002190 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf77015-95a5-41e9-9f33-1a755274d238 service cinder] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:42:01.063763 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf77015-95a5-41e9-9f33-1a755274d238 service cinder] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:42:01.068363 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ba4e9-6b98-45d0-a8f6-6cc227df934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:42:01.068996 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ba4e9-6b98-45d0-a8f6-6cc227df934a admin admin] REQUEST_METHOD: `DELETE` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:01.069281 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ba4e9-6b98-45d0-a8f6-6cc227df934a admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:01.069560 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ba4e9-6b98-45d0-a8f6-6cc227df934a admin admin] PATH_INFO: `/v3/users/58b50195fadf48a28dde42d0a9a010cd` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:01.070683 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ba4e9-6b98-45d0-a8f6-6cc227df934a admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b50195fadf48a28dde42d0a9a010cd)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:42:01.071690 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: WARNING py.warnings [None req-0f6ba4e9-6b98-45d0-a8f6-6cc227df934a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 20:42:01.071690 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: warnings.warn(msg) Sep 24 20:42:01.071690 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: Sep 24 20:42:01.073035 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ba4e9-6b98-45d0-a8f6-6cc227df934a admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:42:01.137422 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-0f6ba4e9-6b98-45d0-a8f6-6cc227df934a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b50195fadf48a28dde42d0a9a010cd'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:42:01.151586 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-0f6ba4e9-6b98-45d0-a8f6-6cc227df934a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b50195fadf48a28dde42d0a9a010cd'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:42:01.152268 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-0f6ba4e9-6b98-45d0-a8f6-6cc227df934a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b50195fadf48a28dde42d0a9a010cd'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:42:01.153064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-0f6ba4e9-6b98-45d0-a8f6-6cc227df934a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b50195fadf48a28dde42d0a9a010cd'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:42:01.177469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-0f6ba4e9-6b98-45d0-a8f6-6cc227df934a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b50195fadf48a28dde42d0a9a010cd'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:42:01.181748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:42:01.194431 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 555/1124] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Sep 24 20:42:01 2022] DELETE /identity/v3/users/58b50195fadf48a28dde42d0a9a010cd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:42:01.198940 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebac1c-9335-4b4c-9e4e-6040aea60425 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:01.199227 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebac1c-9335-4b4c-9e4e-6040aea60425 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:01.199502 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebac1c-9335-4b4c-9e4e-6040aea60425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:01.217957 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-a4ebac1c-9335-4b4c-9e4e-6040aea60425 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:42:01.219156 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-a4ebac1c-9335-4b4c-9e4e-6040aea60425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:42:01.275959 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 570/1125] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:42:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:42:01.286184 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ba4e9-6b98-45d0-a8f6-6cc227df934a admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:42:01.287857 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-0f6ba4e9-6b98-45d0-a8f6-6cc227df934a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:42:01.344473 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ba4e9-6b98-45d0-a8f6-6cc227df934a admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:42:01.348107 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a23810-4808-4709-8215-67c5f744aac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:42:01.348752 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a23810-4808-4709-8215-67c5f744aac6 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:01.349035 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a23810-4808-4709-8215-67c5f744aac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:01.349313 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a23810-4808-4709-8215-67c5f744aac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:01.358316 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a23810-4808-4709-8215-67c5f744aac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:42:01.359772 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a23810-4808-4709-8215-67c5f744aac6 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:42:01.368931 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 556/1126] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:42:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:42:01.713696 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebac1c-9335-4b4c-9e4e-6040aea60425 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:42:01.715136 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-a4ebac1c-9335-4b4c-9e4e-6040aea60425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:42:01.726801 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebac1c-9335-4b4c-9e4e-6040aea60425 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:42:01.731407 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f66614-6ffd-4f89-818c-83f5652760a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:42:01.732035 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f66614-6ffd-4f89-818c-83f5652760a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:42:01.732317 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f66614-6ffd-4f89-818c-83f5652760a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:42:01.732625 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f66614-6ffd-4f89-818c-83f5652760a6 admin admin] PATH_INFO: `/v3/projects/1a37587dc8004989bd8a4743730cc49a` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:42:01.733840 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f66614-6ffd-4f89-818c-83f5652760a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a37587dc8004989bd8a4743730cc49a)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:42:01.734895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: WARNING py.warnings [None req-a6f66614-6ffd-4f89-818c-83f5652760a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 20:42:01.734895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: warnings.warn(msg) Sep 24 20:42:01.734895 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: Sep 24 20:42:01.736121 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f66614-6ffd-4f89-818c-83f5652760a6 admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:42:01.797750 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-a6f66614-6ffd-4f89-818c-83f5652760a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a37587dc8004989bd8a4743730cc49a', 'request_id': 'req-a6f66614-6ffd-4f89-818c-83f5652760a6'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:42:01.810478 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-a6f66614-6ffd-4f89-818c-83f5652760a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a37587dc8004989bd8a4743730cc49a', 'request_id': 'req-a6f66614-6ffd-4f89-818c-83f5652760a6'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:42:01.824508 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-a6f66614-6ffd-4f89-818c-83f5652760a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a37587dc8004989bd8a4743730cc49a', 'request_id': 'req-a6f66614-6ffd-4f89-818c-83f5652760a6'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:42:01.835567 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-a6f66614-6ffd-4f89-818c-83f5652760a6 admin admin] The token cache is being invalidate because project 1a37587dc8004989bd8a4743730cc49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:42:01.835857 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-a6f66614-6ffd-4f89-818c-83f5652760a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:42:01.836528 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-a6f66614-6ffd-4f89-818c-83f5652760a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:42:01.838085 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 571/1127] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Sep 24 20:42:01 2022] DELETE /identity/v3/projects/1a37587dc8004989bd8a4743730cc49a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:42:11.364937 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:42:11.832659 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:43:19.665011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f681d9a-9746-45ad-81e6-5e3c15a20a3a None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:19.665595 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f681d9a-9746-45ad-81e6-5e3c15a20a3a None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:19.665595 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f681d9a-9746-45ad-81e6-5e3c15a20a3a None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:19.666930 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 557/1128] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 20:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:43:19.672182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b18e4-2f5c-4b96-9367-87dddeaa042e None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:19.672663 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b18e4-2f5c-4b96-9367-87dddeaa042e None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:19.672772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b18e4-2f5c-4b96-9367-87dddeaa042e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:19.692641 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-e36b18e4-2f5c-4b96-9367-87dddeaa042e None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:43:19.693834 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-e36b18e4-2f5c-4b96-9367-87dddeaa042e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:43:19.753786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 572/1129] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 20:43:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:43:19.915407 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f681d9a-9746-45ad-81e6-5e3c15a20a3a None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:43:19.917119 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-0f681d9a-9746-45ad-81e6-5e3c15a20a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:43:20.004938 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f681d9a-9746-45ad-81e6-5e3c15a20a3a None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:43:20.009890 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926e1d2-dddc-4c30-9d67-bc39b570602b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:43:20.010483 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926e1d2-dddc-4c30-9d67-bc39b570602b service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:20.010842 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926e1d2-dddc-4c30-9d67-bc39b570602b service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:20.011118 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926e1d2-dddc-4c30-9d67-bc39b570602b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:20.019980 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926e1d2-dddc-4c30-9d67-bc39b570602b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:43:20.021625 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926e1d2-dddc-4c30-9d67-bc39b570602b service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:43:20.031497 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 558/1130] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:43:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:43:21.679687 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe983f91-281e-43ac-aeaa-a52adba68076 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:21.680232 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe983f91-281e-43ac-aeaa-a52adba68076 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:21.680232 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe983f91-281e-43ac-aeaa-a52adba68076 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:21.681624 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 573/1131] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 20:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:43:21.686546 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074b5dc-f6a3-423b-81b0-40df692dd145 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:21.686952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074b5dc-f6a3-423b-81b0-40df692dd145 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:21.687103 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074b5dc-f6a3-423b-81b0-40df692dd145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:21.706929 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-0074b5dc-f6a3-423b-81b0-40df692dd145 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:43:21.708122 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-0074b5dc-f6a3-423b-81b0-40df692dd145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:43:21.716321 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 559/1132] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 20:43:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:43:21.873765 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe983f91-281e-43ac-aeaa-a52adba68076 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:43:21.887613 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe983f91-281e-43ac-aeaa-a52adba68076 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:43:21.892545 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bfd6d-23bb-41d7-8a47-3fc014e1642d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:43:21.893138 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bfd6d-23bb-41d7-8a47-3fc014e1642d service nova] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:21.893424 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bfd6d-23bb-41d7-8a47-3fc014e1642d service nova] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:21.893818 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bfd6d-23bb-41d7-8a47-3fc014e1642d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:21.901917 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243bfd6d-23bb-41d7-8a47-3fc014e1642d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:43:21.904071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243bfd6d-23bb-41d7-8a47-3fc014e1642d service nova] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:43:21.913863 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 574/1133] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:43:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:43:25.134226 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea790917-1b20-41a9-a471-b69f699b17df None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:25.134792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea790917-1b20-41a9-a471-b69f699b17df None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:25.134792 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea790917-1b20-41a9-a471-b69f699b17df None None] PATH_INFO: `/v3` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:25.136035 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 560/1134] 10.222.0.71 () {54 vars in 925 bytes} [Sat Sep 24 20:43:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 20:43:25.142122 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba16e1-7675-4f46-b994-9b1689947788 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:25.142547 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba16e1-7675-4f46-b994-9b1689947788 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:25.142706 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba16e1-7675-4f46-b994-9b1689947788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:25.174188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-e8ba16e1-7675-4f46-b994-9b1689947788 None None] MFA Rules not processed for user `d3060c5a247f495990fd7eec99c0ee0a`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:43:25.175425 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-e8ba16e1-7675-4f46-b994-9b1689947788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:43:25.236996 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 575/1135] 10.222.0.71 () {58 vars in 1015 bytes} [Sat Sep 24 20:43:25 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:43:28.960868 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb255259-7639-44df-a2ac-76d632f2f892 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:28.961294 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb255259-7639-44df-a2ac-76d632f2f892 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:28.961426 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb255259-7639-44df-a2ac-76d632f2f892 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:28.962767 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 561/1136] 10.222.0.61 () {54 vars in 961 bytes} [Sat Sep 24 20:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:43:28.967512 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e752024-f936-42b3-b4c0-aa8ac20b9c66 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:28.967903 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e752024-f936-42b3-b4c0-aa8ac20b9c66 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:28.968067 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e752024-f936-42b3-b4c0-aa8ac20b9c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:28.991555 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-6e752024-f936-42b3-b4c0-aa8ac20b9c66 None None] MFA Rules not processed for user `d3060c5a247f495990fd7eec99c0ee0a`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:43:28.991555 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-6e752024-f936-42b3-b4c0-aa8ac20b9c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:43:28.998686 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 576/1137] 10.222.0.61 () {58 vars in 1058 bytes} [Sat Sep 24 20:43:28 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:43:29.005977 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb255259-7639-44df-a2ac-76d632f2f892 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:43:29.022683 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb255259-7639-44df-a2ac-76d632f2f892 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:43:29.027658 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912c3dd-bbc0-4ec5-8c1b-b499ed341efc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3060c5a247f495990fd7eec99c0ee0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:43:29.028253 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912c3dd-bbc0-4ec5-8c1b-b499ed341efc service placement] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:29.028574 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912c3dd-bbc0-4ec5-8c1b-b499ed341efc service placement] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:29.029193 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912c3dd-bbc0-4ec5-8c1b-b499ed341efc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:29.038175 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912c3dd-bbc0-4ec5-8c1b-b499ed341efc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:43:29.039735 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912c3dd-bbc0-4ec5-8c1b-b499ed341efc service placement] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:43:29.049401 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 562/1138] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:43:29 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:43:33.963263 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488241b7-b8d8-4d5e-b63d-46d7204e3d55 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:33.963860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488241b7-b8d8-4d5e-b63d-46d7204e3d55 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:33.963860 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488241b7-b8d8-4d5e-b63d-46d7204e3d55 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:33.965167 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 577/1139] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 20:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:43:33.970608 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f0289-031f-4e91-a902-2c7fced1d7df None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:33.971070 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f0289-031f-4e91-a902-2c7fced1d7df None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:33.971181 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f0289-031f-4e91-a902-2c7fced1d7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:33.990438 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-934f0289-031f-4e91-a902-2c7fced1d7df None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:43:33.991643 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-934f0289-031f-4e91-a902-2c7fced1d7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:43:34.000961 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 563/1140] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 20:43:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:43:34.159940 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488241b7-b8d8-4d5e-b63d-46d7204e3d55 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:43:34.175863 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488241b7-b8d8-4d5e-b63d-46d7204e3d55 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:43:34.180703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4539ad-c86b-4268-9fc3-0571593d6a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:43:34.181289 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4539ad-c86b-4268-9fc3-0571593d6a8f service nova] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:34.181563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4539ad-c86b-4268-9fc3-0571593d6a8f service nova] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:34.181832 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4539ad-c86b-4268-9fc3-0571593d6a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:34.190245 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4539ad-c86b-4268-9fc3-0571593d6a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:43:34.191804 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4539ad-c86b-4268-9fc3-0571593d6a8f service nova] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:43:34.200906 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 578/1141] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:43:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:43:35.823322 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bbecd-9c5f-4014-b124-f9e3eed09c46 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:35.823896 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bbecd-9c5f-4014-b124-f9e3eed09c46 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:35.823896 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bbecd-9c5f-4014-b124-f9e3eed09c46 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:35.825230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 564/1142] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 20:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:43:35.830603 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9662364-1aa5-476e-bb3f-7aafee13e5ee None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:35.831016 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9662364-1aa5-476e-bb3f-7aafee13e5ee None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:35.831155 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9662364-1aa5-476e-bb3f-7aafee13e5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:35.851869 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-c9662364-1aa5-476e-bb3f-7aafee13e5ee None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:43:35.853103 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-c9662364-1aa5-476e-bb3f-7aafee13e5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:43:35.861384 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 579/1143] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 20:43:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:43:36.018503 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bbecd-9c5f-4014-b124-f9e3eed09c46 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:43:36.033173 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bbecd-9c5f-4014-b124-f9e3eed09c46 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:43:36.038336 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363bdd3-cd03-4ead-8a07-98f77db3a3e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:43:36.038930 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363bdd3-cd03-4ead-8a07-98f77db3a3e0 service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:36.039212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363bdd3-cd03-4ead-8a07-98f77db3a3e0 service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:36.039488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363bdd3-cd03-4ead-8a07-98f77db3a3e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:36.048373 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363bdd3-cd03-4ead-8a07-98f77db3a3e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:43:36.049922 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363bdd3-cd03-4ead-8a07-98f77db3a3e0 service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:43:36.059055 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 565/1144] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:43:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:43:40.320112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071355d4-067a-40cb-bc38-6a142a81a173 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:40.320710 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071355d4-067a-40cb-bc38-6a142a81a173 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:40.320710 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071355d4-067a-40cb-bc38-6a142a81a173 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:40.321967 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 580/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 20:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:43:40.327160 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b79eaf-0ebe-4792-a22a-9f373201a329 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:40.327609 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b79eaf-0ebe-4792-a22a-9f373201a329 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:40.327742 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b79eaf-0ebe-4792-a22a-9f373201a329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:40.347705 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-36b79eaf-0ebe-4792-a22a-9f373201a329 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:43:40.348925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-36b79eaf-0ebe-4792-a22a-9f373201a329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:43:40.356621 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 566/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 20:43:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:43:40.698997 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071355d4-067a-40cb-bc38-6a142a81a173 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:43:40.700746 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-071355d4-067a-40cb-bc38-6a142a81a173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:43:40.754307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:43:40.769986 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071355d4-067a-40cb-bc38-6a142a81a173 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:43:40.773450 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8cbe3-b21b-480e-870e-54e574ed84fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:43:40.774050 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8cbe3-b21b-480e-870e-54e574ed84fe service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:40.774330 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8cbe3-b21b-480e-870e-54e574ed84fe service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:40.774601 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8cbe3-b21b-480e-870e-54e574ed84fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:40.783573 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8cbe3-b21b-480e-870e-54e574ed84fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:43:40.785116 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8cbe3-b21b-480e-870e-54e574ed84fe service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:43:40.794554 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 581/1147] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:43:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:43:43.213206 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9a7b6-0e95-4575-91af-9c919666971f None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:43.213758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9a7b6-0e95-4575-91af-9c919666971f None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:43.213758 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9a7b6-0e95-4575-91af-9c919666971f None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:43.215072 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 567/1148] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 20:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:43:43.220740 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0faf61-c3c1-4729-be1c-768faab77006 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:43.221157 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0faf61-c3c1-4729-be1c-768faab77006 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:43.221285 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0faf61-c3c1-4729-be1c-768faab77006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:43.240554 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-fe0faf61-c3c1-4729-be1c-768faab77006 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:43:43.241728 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-fe0faf61-c3c1-4729-be1c-768faab77006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:43:43.250054 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 582/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 20:43:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:43:43.601661 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9a7b6-0e95-4575-91af-9c919666971f None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:43:43.603372 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-55b9a7b6-0e95-4575-91af-9c919666971f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:43:43.610972 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=61 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:43:43.617483 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9a7b6-0e95-4575-91af-9c919666971f None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:43:43.620993 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9f78a-58ff-4699-9af5-ee7b299487a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:43:43.621582 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9f78a-58ff-4699-9af5-ee7b299487a5 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:43.621863 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9f78a-58ff-4699-9af5-ee7b299487a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:43.622136 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9f78a-58ff-4699-9af5-ee7b299487a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:43.631093 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9f78a-58ff-4699-9af5-ee7b299487a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:43:43.632519 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9f78a-58ff-4699-9af5-ee7b299487a5 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:43:43.642328 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 568/1150] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:43:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:43:47.516096 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bb84d-94b1-4b08-b526-bd4e8cb63776 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:47.516697 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bb84d-94b1-4b08-b526-bd4e8cb63776 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:47.516697 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bb84d-94b1-4b08-b526-bd4e8cb63776 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:47.517986 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 583/1151] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 20:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:43:47.523186 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1ec80-90a2-4c80-a487-79431593c6a4 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:47.523612 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1ec80-90a2-4c80-a487-79431593c6a4 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:47.523714 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1ec80-90a2-4c80-a487-79431593c6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:47.544511 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-46b1ec80-90a2-4c80-a487-79431593c6a4 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:43:47.546441 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-46b1ec80-90a2-4c80-a487-79431593c6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:43:47.554586 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 569/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 20:43:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:43:47.913324 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bb84d-94b1-4b08-b526-bd4e8cb63776 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:43:47.915043 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-152bb84d-94b1-4b08-b526-bd4e8cb63776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:43:47.985092 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152bb84d-94b1-4b08-b526-bd4e8cb63776 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:43:47.988632 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b043bc9-556f-42ce-b74f-2548b39d8067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6e1fa10cb9487d8b346800e360c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:43:47.989233 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b043bc9-556f-42ce-b74f-2548b39d8067 service cinder] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:47.989515 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b043bc9-556f-42ce-b74f-2548b39d8067 service cinder] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:47.989790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b043bc9-556f-42ce-b74f-2548b39d8067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:47.999246 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b043bc9-556f-42ce-b74f-2548b39d8067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:43:48.000705 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b043bc9-556f-42ce-b74f-2548b39d8067 service cinder] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:43:48.009799 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 584/1153] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:43:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:43:50.377053 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846ba54-07c7-4ec6-b927-87394624726e None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:50.377599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846ba54-07c7-4ec6-b927-87394624726e None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:50.377599 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846ba54-07c7-4ec6-b927-87394624726e None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:50.378873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 570/1154] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 20:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:43:50.384107 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f0a2b-4070-45dd-9afe-a33a96945ccb None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:50.384575 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f0a2b-4070-45dd-9afe-a33a96945ccb None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:50.384704 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f0a2b-4070-45dd-9afe-a33a96945ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:50.405148 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-3d6f0a2b-4070-45dd-9afe-a33a96945ccb None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:43:50.406334 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-3d6f0a2b-4070-45dd-9afe-a33a96945ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:43:50.414279 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 585/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 20:43:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:43:50.776134 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846ba54-07c7-4ec6-b927-87394624726e None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:43:50.777810 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-9846ba54-07c7-4ec6-b927-87394624726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:43:50.791896 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846ba54-07c7-4ec6-b927-87394624726e None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:43:50.796023 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d7b07-8fab-47c4-8813-29c9402ca114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e6e1fa10cb9487d8b346800e360c7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:43:50.796639 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d7b07-8fab-47c4-8813-29c9402ca114 service cinder] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:43:50.796920 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d7b07-8fab-47c4-8813-29c9402ca114 service cinder] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:43:50.797193 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d7b07-8fab-47c4-8813-29c9402ca114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:43:50.806632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d7b07-8fab-47c4-8813-29c9402ca114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:43:50.808047 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d7b07-8fab-47c4-8813-29c9402ca114 service cinder] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:43:50.817452 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 571/1156] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:43:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:44:00.399810 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=46 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:44:00.813324 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=14 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:45:04.248923 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b820a0-7a6f-4804-9657-c1542995068c None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.249565 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b820a0-7a6f-4804-9657-c1542995068c None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.249565 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b820a0-7a6f-4804-9657-c1542995068c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.268863 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-e1b820a0-7a6f-4804-9657-c1542995068c None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:04.270091 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-e1b820a0-7a6f-4804-9657-c1542995068c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:04.278424 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 586/1157] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:45:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:45:04.287277 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd472de2-477e-4bb5-8bf7-cfeef4d78ccf None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.287814 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd472de2-477e-4bb5-8bf7-cfeef4d78ccf None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.287915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd472de2-477e-4bb5-8bf7-cfeef4d78ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.295423 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f4b17-38c0-4ed1-9cab-d3ab97b51e04 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.295713 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f4b17-38c0-4ed1-9cab-d3ab97b51e04 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.295994 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f4b17-38c0-4ed1-9cab-d3ab97b51e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.308579 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-dd472de2-477e-4bb5-8bf7-cfeef4d78ccf None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:04.310437 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-dd472de2-477e-4bb5-8bf7-cfeef4d78ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:04.317879 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-487f4b17-38c0-4ed1-9cab-d3ab97b51e04 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:04.319166 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-487f4b17-38c0-4ed1-9cab-d3ab97b51e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:04.322790 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 572/1158] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:45:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:45:04.328147 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 587/1159] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:45:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:45:04.328318 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd472de2-477e-4bb5-8bf7-cfeef4d78ccf None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:04.336786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2366212-1dbc-49a5-ae92-758dca031ae2 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.337071 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2366212-1dbc-49a5-ae92-758dca031ae2 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.337347 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2366212-1dbc-49a5-ae92-758dca031ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.338693 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd472de2-477e-4bb5-8bf7-cfeef4d78ccf None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:04.344073 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23649921-266c-4e7d-a57a-da430432d53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:04.344723 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23649921-266c-4e7d-a57a-da430432d53f admin admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.345012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23649921-266c-4e7d-a57a-da430432d53f admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.345292 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23649921-266c-4e7d-a57a-da430432d53f admin admin] PATH_INFO: `/v3/domains` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.345941 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23649921-266c-4e7d-a57a-da430432d53f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94880) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:45:04.346255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23649921-266c-4e7d-a57a-da430432d53f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:04.347267 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: WARNING py.warnings [None req-23649921-266c-4e7d-a57a-da430432d53f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 20:45:04.347267 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: warnings.warn(msg) Sep 24 20:45:04.347267 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: Sep 24 20:45:04.348155 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23649921-266c-4e7d-a57a-da430432d53f admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:04.358204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-e2366212-1dbc-49a5-ae92-758dca031ae2 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:04.359328 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-e2366212-1dbc-49a5-ae92-758dca031ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:04.360059 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 573/1160] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Sep 24 20:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:45:04.370857 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 588/1161] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:45:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:45:04.371029 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23649921-266c-4e7d-a57a-da430432d53f admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:04.371836 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2366212-1dbc-49a5-ae92-758dca031ae2 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:04.378177 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23649921-266c-4e7d-a57a-da430432d53f admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:04.380855 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2366212-1dbc-49a5-ae92-758dca031ae2 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:04.382779 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545475b-d0fb-48fc-8759-26d5538291de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:04.383373 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545475b-d0fb-48fc-8759-26d5538291de admin admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.383653 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545475b-d0fb-48fc-8759-26d5538291de admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.383927 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545475b-d0fb-48fc-8759-26d5538291de admin admin] PATH_INFO: `/v3/projects` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.384588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545475b-d0fb-48fc-8759-26d5538291de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:04.386055 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d5801-3590-401f-9a6f-9c1f3a31445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:04.386645 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d5801-3590-401f-9a6f-9c1f3a31445a admin admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.386927 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d5801-3590-401f-9a6f-9c1f3a31445a admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.387030 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545475b-d0fb-48fc-8759-26d5538291de admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:04.387202 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d5801-3590-401f-9a6f-9c1f3a31445a admin admin] PATH_INFO: `/v3/domains` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.387837 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d5801-3590-401f-9a6f-9c1f3a31445a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=94879) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 20:45:04.388143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d5801-3590-401f-9a6f-9c1f3a31445a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:04.389841 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d5801-3590-401f-9a6f-9c1f3a31445a admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:04.402096 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 589/1162] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Sep 24 20:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 20:45:04.410829 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d5801-3590-401f-9a6f-9c1f3a31445a admin admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:04.415708 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 574/1163] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Sep 24 20:45:04 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:45:04.419822 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545475b-d0fb-48fc-8759-26d5538291de admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:04.421751 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d5801-3590-401f-9a6f-9c1f3a31445a admin admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:04.479638 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57ad05-671d-48b8-886d-6afbac62f934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:04.480244 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57ad05-671d-48b8-886d-6afbac62f934 admin admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.480573 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57ad05-671d-48b8-886d-6afbac62f934 admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.480852 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57ad05-671d-48b8-886d-6afbac62f934 admin admin] PATH_INFO: `/v3/projects` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.481481 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57ad05-671d-48b8-886d-6afbac62f934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:04.482481 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: WARNING py.warnings [None req-3d57ad05-671d-48b8-886d-6afbac62f934 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 20:45:04.482481 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: warnings.warn(msg) Sep 24 20:45:04.482481 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: Sep 24 20:45:04.483680 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57ad05-671d-48b8-886d-6afbac62f934 admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:04.485056 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545475b-d0fb-48fc-8759-26d5538291de admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:04.489807 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ee5e6-cdc9-48b7-abe3-1294dfad01b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:04.490462 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ee5e6-cdc9-48b7-abe3-1294dfad01b5 admin admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.490749 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ee5e6-cdc9-48b7-abe3-1294dfad01b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.491030 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ee5e6-cdc9-48b7-abe3-1294dfad01b5 admin admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.491652 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ee5e6-cdc9-48b7-abe3-1294dfad01b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:04.492722 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: WARNING py.warnings [None req-363ee5e6-cdc9-48b7-abe3-1294dfad01b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 20:45:04.492722 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: warnings.warn(msg) Sep 24 20:45:04.492722 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: Sep 24 20:45:04.493940 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ee5e6-cdc9-48b7-abe3-1294dfad01b5 admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:04.515369 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 590/1164] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Sep 24 20:45:04 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:45:04.516470 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57ad05-671d-48b8-886d-6afbac62f934 admin admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:04.521394 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 575/1165] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Sep 24 20:45:04 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:45:04.522709 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ee5e6-cdc9-48b7-abe3-1294dfad01b5 admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:04.532101 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ee5e6-cdc9-48b7-abe3-1294dfad01b5 admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:04.579740 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57ad05-671d-48b8-886d-6afbac62f934 admin admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:04.584419 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d377b-40b4-4f5c-ac1a-b86e25518f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:04.585022 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d377b-40b4-4f5c-ac1a-b86e25518f3a admin admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.585310 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d377b-40b4-4f5c-ac1a-b86e25518f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.585575 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d377b-40b4-4f5c-ac1a-b86e25518f3a admin admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.586244 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d377b-40b4-4f5c-ac1a-b86e25518f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:04.587840 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc230470-0f33-44d0-a84c-51cebd935b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:04.588499 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc230470-0f33-44d0-a84c-51cebd935b0c admin admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.588782 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc230470-0f33-44d0-a84c-51cebd935b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.588954 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d377b-40b4-4f5c-ac1a-b86e25518f3a admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:04.589076 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc230470-0f33-44d0-a84c-51cebd935b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.589682 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc230470-0f33-44d0-a84c-51cebd935b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:04.591272 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc230470-0f33-44d0-a84c-51cebd935b0c admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:04.601311 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 576/1166] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Sep 24 20:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:45:04.605865 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc230470-0f33-44d0-a84c-51cebd935b0c admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:04.616265 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 591/1167] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Sep 24 20:45:04 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 20:45:04.616469 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc230470-0f33-44d0-a84c-51cebd935b0c admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:04.620549 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d377b-40b4-4f5c-ac1a-b86e25518f3a admin admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:04.624374 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50692ea9-85f1-49cd-8b12-29cb555451b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:04.625204 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50692ea9-85f1-49cd-8b12-29cb555451b9 admin admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.625491 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50692ea9-85f1-49cd-8b12-29cb555451b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.625810 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50692ea9-85f1-49cd-8b12-29cb555451b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.626485 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50692ea9-85f1-49cd-8b12-29cb555451b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:04.628080 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50692ea9-85f1-49cd-8b12-29cb555451b9 admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:04.630714 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d377b-40b4-4f5c-ac1a-b86e25518f3a admin admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:04.635404 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0a804-2f51-44a6-8167-baadcba4b503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:04.635995 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0a804-2f51-44a6-8167-baadcba4b503 admin admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.636281 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0a804-2f51-44a6-8167-baadcba4b503 admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.636587 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0a804-2f51-44a6-8167-baadcba4b503 admin admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.637219 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0a804-2f51-44a6-8167-baadcba4b503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:04.641421 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 577/1168] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Sep 24 20:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:45:04.641572 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0a804-2f51-44a6-8167-baadcba4b503 admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:04.642720 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50692ea9-85f1-49cd-8b12-29cb555451b9 admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:04.651626 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 592/1169] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Sep 24 20:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:45:04.652741 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0a804-2f51-44a6-8167-baadcba4b503 admin admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:04.655078 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50692ea9-85f1-49cd-8b12-29cb555451b9 admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:04.660249 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae46bf-1ba1-4d83-a3f3-c81ed73560d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:04.660963 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae46bf-1ba1-4d83-a3f3-c81ed73560d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.661252 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae46bf-1ba1-4d83-a3f3-c81ed73560d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.661533 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae46bf-1ba1-4d83-a3f3-c81ed73560d8 admin admin] PATH_INFO: `/v3/projects/cfa11f4a154f4696b2ba00e091941b8f/users/60082b3cc2584a168371494e8ce0c59d/roles/3481273c76dc4a20b3f73c4f8ea558e6` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.662550 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0a804-2f51-44a6-8167-baadcba4b503 admin admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:04.667781 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae09f5-c9f5-40a6-9be2-bec4bf42cddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:04.668379 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae09f5-c9f5-40a6-9be2-bec4bf42cddb admin admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.668665 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae09f5-c9f5-40a6-9be2-bec4bf42cddb admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.668939 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae09f5-c9f5-40a6-9be2-bec4bf42cddb admin admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.669562 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae09f5-c9f5-40a6-9be2-bec4bf42cddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:04.671129 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae09f5-c9f5-40a6-9be2-bec4bf42cddb admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:04.676996 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae46bf-1ba1-4d83-a3f3-c81ed73560d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa11f4a154f4696b2ba00e091941b8f, user_id=60082b3cc2584a168371494e8ce0c59d, role_id=3481273c76dc4a20b3f73c4f8ea558e6)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:04.679641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae46bf-1ba1-4d83-a3f3-c81ed73560d8 admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:04.681306 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 593/1170] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Sep 24 20:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:45:04.686435 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae09f5-c9f5-40a6-9be2-bec4bf42cddb admin admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:04.694796 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 578/1171] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Sep 24 20:45:04 2022] PUT /identity/v3/projects/cfa11f4a154f4696b2ba00e091941b8f/users/60082b3cc2584a168371494e8ce0c59d/roles/3481273c76dc4a20b3f73c4f8ea558e6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:45:04.699950 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2e5b0-e113-4a73-be4d-30b7294e82ba None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.700245 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2e5b0-e113-4a73-be4d-30b7294e82ba None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.700499 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae09f5-c9f5-40a6-9be2-bec4bf42cddb admin admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:04.700623 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2e5b0-e113-4a73-be4d-30b7294e82ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.717869 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:45:04.719572 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-8ff2e5b0-e113-4a73-be4d-30b7294e82ba None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:04.720992 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-8ff2e5b0-e113-4a73-be4d-30b7294e82ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:04.725173 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:45:04.761452 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017d2ad-6468-4d8c-9491-59a7c1f42b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:04.762112 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017d2ad-6468-4d8c-9491-59a7c1f42b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.762393 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017d2ad-6468-4d8c-9491-59a7c1f42b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.762668 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017d2ad-6468-4d8c-9491-59a7c1f42b6a admin admin] PATH_INFO: `/v3/projects/c85330c84706491aaa619c8abc97f6a5/users/9bdb4c25481d4e41acd086dafcd08206/roles/3481273c76dc4a20b3f73c4f8ea558e6` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.778024 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017d2ad-6468-4d8c-9491-59a7c1f42b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85330c84706491aaa619c8abc97f6a5, user_id=9bdb4c25481d4e41acd086dafcd08206, role_id=3481273c76dc4a20b3f73c4f8ea558e6)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:04.779176 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: WARNING py.warnings [None req-c017d2ad-6468-4d8c-9491-59a7c1f42b6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 20:45:04.779176 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: warnings.warn(msg) Sep 24 20:45:04.779176 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: Sep 24 20:45:04.781160 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017d2ad-6468-4d8c-9491-59a7c1f42b6a admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:04.785575 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 579/1172] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:45:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:45:04.794902 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 594/1173] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Sep 24 20:45:04 2022] PUT /identity/v3/projects/c85330c84706491aaa619c8abc97f6a5/users/9bdb4c25481d4e41acd086dafcd08206/roles/3481273c76dc4a20b3f73c4f8ea558e6 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:45:04.796147 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2e5b0-e113-4a73-be4d-30b7294e82ba None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:04.799828 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3137-1884-48f8-bdd8-d3bbc79f7593 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.800123 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3137-1884-48f8-bdd8-d3bbc79f7593 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.800449 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e3137-1884-48f8-bdd8-d3bbc79f7593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.820081 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-169e3137-1884-48f8-bdd8-d3bbc79f7593 None None] MFA Rules not processed for user `9f6d7830fd8e4f16950273e6f89f703c`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:04.821418 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-169e3137-1884-48f8-bdd8-d3bbc79f7593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:04.857956 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2e5b0-e113-4a73-be4d-30b7294e82ba None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:04.886573 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 595/1174] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:45:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:45:04.896472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3137-1884-48f8-bdd8-d3bbc79f7593 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:04.907618 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2200c0-433b-41d7-ab2f-7fe742771c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:04.908227 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2200c0-433b-41d7-ab2f-7fe742771c4b service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.908553 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2200c0-433b-41d7-ab2f-7fe742771c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.908834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2200c0-433b-41d7-ab2f-7fe742771c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.918598 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2200c0-433b-41d7-ab2f-7fe742771c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:04.920029 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2200c0-433b-41d7-ab2f-7fe742771c4b service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:04.929768 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 580/1175] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:45:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:45:04.951606 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e3137-1884-48f8-bdd8-d3bbc79f7593 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:04.955283 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a482e-7d97-4914-a86b-6b0d31f47d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:04.955953 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a482e-7d97-4914-a86b-6b0d31f47d26 service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:04.956197 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a482e-7d97-4914-a86b-6b0d31f47d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:04.956499 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a482e-7d97-4914-a86b-6b0d31f47d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:04.966076 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a482e-7d97-4914-a86b-6b0d31f47d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:04.967499 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a482e-7d97-4914-a86b-6b0d31f47d26 service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:04.976858 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 596/1176] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:45:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:45:10.548754 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36fd2e-ffe2-4ca5-b97a-de3afef1999a None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:10.552517 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36fd2e-ffe2-4ca5-b97a-de3afef1999a None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:10.553051 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36fd2e-ffe2-4ca5-b97a-de3afef1999a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:10.659839 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-1e36fd2e-ffe2-4ca5-b97a-de3afef1999a None None] MFA Rules not processed for user `9bdb4c25481d4e41acd086dafcd08206`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:10.661606 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-1e36fd2e-ffe2-4ca5-b97a-de3afef1999a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:10.855764 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:45:10.871005 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 581/1177] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:45:10 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:45:10.875712 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a482e-7d97-4914-a86b-6b0d31f47d26 service neutron] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:10.886378 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a482e-7d97-4914-a86b-6b0d31f47d26 service neutron] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:10.904247 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ccf984-b13f-4368-9b86-336edd91a2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:10.905694 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccf984-b13f-4368-9b86-336edd91a2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:10.907379 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccf984-b13f-4368-9b86-336edd91a2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:10.907768 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccf984-b13f-4368-9b86-336edd91a2f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:10.908940 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ccf984-b13f-4368-9b86-336edd91a2f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:10.914803 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ccf984-b13f-4368-9b86-336edd91a2f2 admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:10.972779 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 597/1178] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Sep 24 20:45:10 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:45:10.976559 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36fd2e-ffe2-4ca5-b97a-de3afef1999a None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:10.989839 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36fd2e-ffe2-4ca5-b97a-de3afef1999a None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:11.038472 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deb810-8432-420c-8bab-4974e889dc35 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:11.038706 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deb810-8432-420c-8bab-4974e889dc35 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:11.038988 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deb810-8432-420c-8bab-4974e889dc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:11.092488 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-12deb810-8432-420c-8bab-4974e889dc35 None None] MFA Rules not processed for user `60082b3cc2584a168371494e8ce0c59d`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:11.093719 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-12deb810-8432-420c-8bab-4974e889dc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:11.108047 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f44a83-2b8e-44f8-9b24-f26ca1c5121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:11.108874 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f44a83-2b8e-44f8-9b24-f26ca1c5121f admin admin] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:11.109313 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:45:11.110382 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f44a83-2b8e-44f8-9b24-f26ca1c5121f admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:11.110897 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f44a83-2b8e-44f8-9b24-f26ca1c5121f admin admin] PATH_INFO: `/v3/users` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:11.111634 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f44a83-2b8e-44f8-9b24-f26ca1c5121f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:11.113781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f44a83-2b8e-44f8-9b24-f26ca1c5121f admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:11.153927 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 582/1179] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Sep 24 20:45:10 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:45:11.158781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f44a83-2b8e-44f8-9b24-f26ca1c5121f admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:11.177129 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f44a83-2b8e-44f8-9b24-f26ca1c5121f admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:11.184554 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1956b8b-f239-4f6c-b15e-9a5cf474d415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:11.185749 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1956b8b-f239-4f6c-b15e-9a5cf474d415 admin admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:11.186031 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1956b8b-f239-4f6c-b15e-9a5cf474d415 admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:11.186320 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1956b8b-f239-4f6c-b15e-9a5cf474d415 admin admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:11.187110 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1956b8b-f239-4f6c-b15e-9a5cf474d415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:11.188776 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1956b8b-f239-4f6c-b15e-9a5cf474d415 admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:11.196843 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 598/1180] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:45:11 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:45:11.198310 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12deb810-8432-420c-8bab-4974e889dc35 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:11.201800 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 583/1181] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Sep 24 20:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:45:11.205495 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1956b8b-f239-4f6c-b15e-9a5cf474d415 admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:11.212765 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12deb810-8432-420c-8bab-4974e889dc35 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:11.218245 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13909d9-9758-4115-9b54-7be4b8be52cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:11.218920 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13909d9-9758-4115-9b54-7be4b8be52cb admin admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:11.219203 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13909d9-9758-4115-9b54-7be4b8be52cb admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:11.219478 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13909d9-9758-4115-9b54-7be4b8be52cb admin admin] PATH_INFO: `/v3/projects` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:11.219653 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1956b8b-f239-4f6c-b15e-9a5cf474d415 admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:11.220254 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13909d9-9758-4115-9b54-7be4b8be52cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:11.222622 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13909d9-9758-4115-9b54-7be4b8be52cb admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:11.225203 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f548e0b-3e91-4bf4-a600-dd81e8ca33ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:11.226240 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f548e0b-3e91-4bf4-a600-dd81e8ca33ee admin admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:11.226584 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f548e0b-3e91-4bf4-a600-dd81e8ca33ee admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:11.226951 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f548e0b-3e91-4bf4-a600-dd81e8ca33ee admin admin] PATH_INFO: `/v3/projects/7b94ccdd894f40bfb62d3735c746c630/users/f198a2d9c10e4898ab9e9ae9544dad7f/roles/9cc90aa0ccde4b75b7642101cbf45cf2` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:11.249169 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f548e0b-3e91-4bf4-a600-dd81e8ca33ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b94ccdd894f40bfb62d3735c746c630, user_id=f198a2d9c10e4898ab9e9ae9544dad7f, role_id=9cc90aa0ccde4b75b7642101cbf45cf2)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:11.252258 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f548e0b-3e91-4bf4-a600-dd81e8ca33ee admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:11.270577 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 599/1182] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Sep 24 20:45:11 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:45:11.271605 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13909d9-9758-4115-9b54-7be4b8be52cb admin admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:11.275085 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 584/1183] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Sep 24 20:45:11 2022] PUT /identity/v3/projects/7b94ccdd894f40bfb62d3735c746c630/users/f198a2d9c10e4898ab9e9ae9544dad7f/roles/9cc90aa0ccde4b75b7642101cbf45cf2 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:45:11.276905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f548e0b-3e91-4bf4-a600-dd81e8ca33ee admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:11.346807 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f548e0b-3e91-4bf4-a600-dd81e8ca33ee admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:11.352273 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af163d6-6e81-49d9-919a-4ae8bc51b165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:11.352925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af163d6-6e81-49d9-919a-4ae8bc51b165 admin admin] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:11.353212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af163d6-6e81-49d9-919a-4ae8bc51b165 admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:11.353488 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af163d6-6e81-49d9-919a-4ae8bc51b165 admin admin] PATH_INFO: `/v3/roles` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:11.354650 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af163d6-6e81-49d9-919a-4ae8bc51b165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:11.355706 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13909d9-9758-4115-9b54-7be4b8be52cb admin admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:11.356243 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af163d6-6e81-49d9-919a-4ae8bc51b165 admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:11.361041 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61984c7d-586f-4e7b-a3b1-5eb3a90d33d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:11.361854 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984c7d-586f-4e7b-a3b1-5eb3a90d33d6 admin admin] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:11.362397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984c7d-586f-4e7b-a3b1-5eb3a90d33d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:11.362675 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61984c7d-586f-4e7b-a3b1-5eb3a90d33d6 admin admin] PATH_INFO: `/v3/users` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:11.363356 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61984c7d-586f-4e7b-a3b1-5eb3a90d33d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:11.365280 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61984c7d-586f-4e7b-a3b1-5eb3a90d33d6 admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:11.368378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 585/1184] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Sep 24 20:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 20:45:11.371924 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af163d6-6e81-49d9-919a-4ae8bc51b165 admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:11.383827 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af163d6-6e81-49d9-919a-4ae8bc51b165 admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:11.389480 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ef6a4-cbad-45a3-b05a-e7c09fc36173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:11.390194 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ef6a4-cbad-45a3-b05a-e7c09fc36173 admin admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:11.390475 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ef6a4-cbad-45a3-b05a-e7c09fc36173 admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:11.390750 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ef6a4-cbad-45a3-b05a-e7c09fc36173 admin admin] PATH_INFO: `/v3/projects/7b94ccdd894f40bfb62d3735c746c630/users/f198a2d9c10e4898ab9e9ae9544dad7f/roles/9cc90aa0ccde4b75b7642101cbf45cf2` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:11.392991 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ef6a4-cbad-45a3-b05a-e7c09fc36173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b94ccdd894f40bfb62d3735c746c630, user_id=f198a2d9c10e4898ab9e9ae9544dad7f, role_id=9cc90aa0ccde4b75b7642101cbf45cf2)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:11.393135 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 600/1185] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Sep 24 20:45:11 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 20:45:11.396813 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61984c7d-586f-4e7b-a3b1-5eb3a90d33d6 admin admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:11.399026 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ef6a4-cbad-45a3-b05a-e7c09fc36173 admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:11.407452 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61984c7d-586f-4e7b-a3b1-5eb3a90d33d6 admin admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:11.415336 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 586/1186] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Sep 24 20:45:11 2022] PUT /identity/v3/projects/7b94ccdd894f40bfb62d3735c746c630/users/f198a2d9c10e4898ab9e9ae9544dad7f/roles/9cc90aa0ccde4b75b7642101cbf45cf2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:45:11.514613 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707dd9b-bb8a-4eb7-bf40-1c681f1c2598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:11.515510 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707dd9b-bb8a-4eb7-bf40-1c681f1c2598 admin admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:11.515898 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707dd9b-bb8a-4eb7-bf40-1c681f1c2598 admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:11.516996 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707dd9b-bb8a-4eb7-bf40-1c681f1c2598 admin admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:11.517776 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707dd9b-bb8a-4eb7-bf40-1c681f1c2598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:11.520230 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707dd9b-bb8a-4eb7-bf40-1c681f1c2598 admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:11.536557 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 601/1187] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Sep 24 20:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:45:11.540562 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ef6a4-cbad-45a3-b05a-e7c09fc36173 admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:11.553855 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ef6a4-cbad-45a3-b05a-e7c09fc36173 admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:11.560718 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894c73f-c61a-49b3-9ce9-39f9a094516b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:11.561387 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894c73f-c61a-49b3-9ce9-39f9a094516b admin admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:11.561667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894c73f-c61a-49b3-9ce9-39f9a094516b admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:11.561947 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894c73f-c61a-49b3-9ce9-39f9a094516b admin admin] PATH_INFO: `/v3/projects/41bcc59c32794af594ec0b0e421ad983/users/67cadebf94f5462eb354bf03efb84423/roles/9cc90aa0ccde4b75b7642101cbf45cf2` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:11.585707 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894c73f-c61a-49b3-9ce9-39f9a094516b admin admin] RBAC: Authorizing `identity:create_grant(project_id=41bcc59c32794af594ec0b0e421ad983, user_id=67cadebf94f5462eb354bf03efb84423, role_id=9cc90aa0ccde4b75b7642101cbf45cf2)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:11.598019 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894c73f-c61a-49b3-9ce9-39f9a094516b admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:11.617988 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 587/1188] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Sep 24 20:45:11 2022] PUT /identity/v3/projects/41bcc59c32794af594ec0b0e421ad983/users/67cadebf94f5462eb354bf03efb84423/roles/9cc90aa0ccde4b75b7642101cbf45cf2 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:45:11.622119 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707dd9b-bb8a-4eb7-bf40-1c681f1c2598 admin admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:11.632845 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707dd9b-bb8a-4eb7-bf40-1c681f1c2598 admin admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:11.647783 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:45:11.735713 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22852e24-d8ae-45eb-89f5-1f0597d4ced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:11.736635 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22852e24-d8ae-45eb-89f5-1f0597d4ced2 admin admin] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:11.737016 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22852e24-d8ae-45eb-89f5-1f0597d4ced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:11.737962 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22852e24-d8ae-45eb-89f5-1f0597d4ced2 admin admin] PATH_INFO: `/v3/roles` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:11.738832 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22852e24-d8ae-45eb-89f5-1f0597d4ced2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:11.740723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22852e24-d8ae-45eb-89f5-1f0597d4ced2 admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:11.753143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 602/1189] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Sep 24 20:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 20:45:11.757876 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894c73f-c61a-49b3-9ce9-39f9a094516b admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:11.772760 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894c73f-c61a-49b3-9ce9-39f9a094516b admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:11.779809 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e1f82-0d08-47e0-9876-c0dbd382b3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:11.780532 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e1f82-0d08-47e0-9876-c0dbd382b3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:11.781230 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e1f82-0d08-47e0-9876-c0dbd382b3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:11.781518 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e1f82-0d08-47e0-9876-c0dbd382b3a5 admin admin] PATH_INFO: `/v3/projects/41bcc59c32794af594ec0b0e421ad983/users/67cadebf94f5462eb354bf03efb84423/roles/9cc90aa0ccde4b75b7642101cbf45cf2` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:11.788326 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e1f82-0d08-47e0-9876-c0dbd382b3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41bcc59c32794af594ec0b0e421ad983, user_id=67cadebf94f5462eb354bf03efb84423, role_id=9cc90aa0ccde4b75b7642101cbf45cf2)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:11.790983 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e1f82-0d08-47e0-9876-c0dbd382b3a5 admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:11.812207 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:45:11.833620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 588/1190] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Sep 24 20:45:11 2022] PUT /identity/v3/projects/41bcc59c32794af594ec0b0e421ad983/users/67cadebf94f5462eb354bf03efb84423/roles/9cc90aa0ccde4b75b7642101cbf45cf2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:45:17.938974 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c03cf-6d60-447b-ac16-d591ca336f67 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:17.939940 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c03cf-6d60-447b-ac16-d591ca336f67 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:17.940529 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c03cf-6d60-447b-ac16-d591ca336f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:18.001919 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-105c03cf-6d60-447b-ac16-d591ca336f67 None None] MFA Rules not processed for user `f198a2d9c10e4898ab9e9ae9544dad7f`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:18.003179 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-105c03cf-6d60-447b-ac16-d591ca336f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:18.179411 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 603/1191] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:45:17 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:45:18.191188 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e1f82-0d08-47e0-9876-c0dbd382b3a5 admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:18.193961 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-407e1f82-0d08-47e0-9876-c0dbd382b3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:18.315472 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e1f82-0d08-47e0-9876-c0dbd382b3a5 admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:18.320961 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737835d-8298-4c66-a816-996ae5ac8c14 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b505bdb933aa4bffa870851e4cb87c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:18.322019 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737835d-8298-4c66-a816-996ae5ac8c14 service glance] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:18.323256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737835d-8298-4c66-a816-996ae5ac8c14 service glance] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:18.323899 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737835d-8298-4c66-a816-996ae5ac8c14 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:18.454148 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737835d-8298-4c66-a816-996ae5ac8c14 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:18.455626 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737835d-8298-4c66-a816-996ae5ac8c14 service glance] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:18.466774 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 589/1192] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:45:18 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:45:18.697635 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaac0a-c6fb-4090-bce2-058cce152139 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:18.697935 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaac0a-c6fb-4090-bce2-058cce152139 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:18.698213 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaac0a-c6fb-4090-bce2-058cce152139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:18.746927 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-4afaac0a-c6fb-4090-bce2-058cce152139 None None] MFA Rules not processed for user `67cadebf94f5462eb354bf03efb84423`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:18.748919 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-4afaac0a-c6fb-4090-bce2-058cce152139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:18.856575 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 604/1193] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:45:18 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:45:18.870853 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737835d-8298-4c66-a816-996ae5ac8c14 service glance] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:18.880391 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737835d-8298-4c66-a816-996ae5ac8c14 service glance] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:18.884558 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f04fd-27a5-4be9-be24-5fa57dd8927d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b505bdb933aa4bffa870851e4cb87c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:18.885563 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f04fd-27a5-4be9-be24-5fa57dd8927d service glance] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:18.885563 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f04fd-27a5-4be9-be24-5fa57dd8927d service glance] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:18.885748 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f04fd-27a5-4be9-be24-5fa57dd8927d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:18.970586 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f04fd-27a5-4be9-be24-5fa57dd8927d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:18.972178 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f04fd-27a5-4be9-be24-5fa57dd8927d service glance] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:18.982929 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 590/1194] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:45:18 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:45:27.937661 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afd71d-9b7c-43fa-b72b-457a70bdb19d None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:27.938320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afd71d-9b7c-43fa-b72b-457a70bdb19d None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:27.938320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15afd71d-9b7c-43fa-b72b-457a70bdb19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:27.958555 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-15afd71d-9b7c-43fa-b72b-457a70bdb19d None None] MFA Rules not processed for user `60082b3cc2584a168371494e8ce0c59d`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:27.960011 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-15afd71d-9b7c-43fa-b72b-457a70bdb19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:27.970303 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 605/1195] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:45:27 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:45:28.276616 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101b925-a8c2-4e58-bb31-433b370e0c09 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:28.277917 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101b925-a8c2-4e58-bb31-433b370e0c09 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:28.278706 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101b925-a8c2-4e58-bb31-433b370e0c09 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:28.281649 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 591/1196] 10.222.0.61 () {54 vars in 961 bytes} [Sat Sep 24 20:45:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:45:28.288683 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46128729-c500-451a-b7d7-6c29eb700f0c None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:28.288990 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46128729-c500-451a-b7d7-6c29eb700f0c None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:28.289269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46128729-c500-451a-b7d7-6c29eb700f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:28.315637 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=100 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:45:28.321328 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-46128729-c500-451a-b7d7-6c29eb700f0c None None] MFA Rules not processed for user `bc96ad30b91b46af92ff5b27a6b83abd`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:28.323136 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-46128729-c500-451a-b7d7-6c29eb700f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:28.389121 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 606/1197] 10.222.0.61 () {58 vars in 1058 bytes} [Sat Sep 24 20:45:28 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:45:28.394431 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9663fc-a306-4b23-bb25-79635b4c648b None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:28.394726 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9663fc-a306-4b23-bb25-79635b4c648b None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:28.395020 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9663fc-a306-4b23-bb25-79635b4c648b None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:28.396442 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 592/1198] 10.222.0.61 () {54 vars in 912 bytes} [Sat Sep 24 20:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:45:28.401491 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5b213-dc38-4573-9967-678b1aedb98f None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:28.401780 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5b213-dc38-4573-9967-678b1aedb98f None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:28.402240 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5b213-dc38-4573-9967-678b1aedb98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:28.421692 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-d1a5b213-dc38-4573-9967-678b1aedb98f None None] MFA Rules not processed for user `bc96ad30b91b46af92ff5b27a6b83abd`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:28.422894 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-d1a5b213-dc38-4573-9967-678b1aedb98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:28.432060 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 607/1199] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Sep 24 20:45:28 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:45:28.444711 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9663fc-a306-4b23-bb25-79635b4c648b None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:28.446761 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-6f9663fc-a306-4b23-bb25-79635b4c648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:28.460935 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9663fc-a306-4b23-bb25-79635b4c648b None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:28.466439 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b38c5e-4bcb-4145-b793-f54da1d60bf8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b505bdb933aa4bffa870851e4cb87c59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:28.467057 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b38c5e-4bcb-4145-b793-f54da1d60bf8 service glance] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:28.467333 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b38c5e-4bcb-4145-b793-f54da1d60bf8 service glance] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:28.467605 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b38c5e-4bcb-4145-b793-f54da1d60bf8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:28.479167 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b38c5e-4bcb-4145-b793-f54da1d60bf8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:28.481110 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b38c5e-4bcb-4145-b793-f54da1d60bf8 service glance] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:28.494718 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 593/1200] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:45:28 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:45:28.859052 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be596f-c476-4884-aa8f-72e4eada38b3 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:28.859332 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be596f-c476-4884-aa8f-72e4eada38b3 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:28.859609 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be596f-c476-4884-aa8f-72e4eada38b3 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:28.860983 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 608/1201] 10.222.0.61 () {54 vars in 912 bytes} [Sat Sep 24 20:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:45:28.866396 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc4653-0b87-4b9d-92d7-669f3c29a3a4 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:28.866878 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc4653-0b87-4b9d-92d7-669f3c29a3a4 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:28.867170 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc4653-0b87-4b9d-92d7-669f3c29a3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:28.888683 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-19fc4653-0b87-4b9d-92d7-669f3c29a3a4 None None] MFA Rules not processed for user `0e97928ca3294ebdbc53468d84c64b26`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:28.889918 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-19fc4653-0b87-4b9d-92d7-669f3c29a3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:28.911877 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=100 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:45:28.945766 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 594/1202] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Sep 24 20:45:28 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:45:28.958669 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be596f-c476-4884-aa8f-72e4eada38b3 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:28.972269 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be596f-c476-4884-aa8f-72e4eada38b3 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:28.976144 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e985e-9164-45e0-8382-9c57dc3481e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:28.976873 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e985e-9164-45e0-8382-9c57dc3481e2 service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:28.977158 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e985e-9164-45e0-8382-9c57dc3481e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:28.977426 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e985e-9164-45e0-8382-9c57dc3481e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:28.985856 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e985e-9164-45e0-8382-9c57dc3481e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:28.987297 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e985e-9164-45e0-8382-9c57dc3481e2 service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:28.995811 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 609/1203] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:45:28 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:45:29.457234 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91577e4e-0273-4d48-97c4-2df73480e452 None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:29.457729 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91577e4e-0273-4d48-97c4-2df73480e452 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:29.458714 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91577e4e-0273-4d48-97c4-2df73480e452 None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:29.461449 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 595/1204] 10.222.0.61 () {54 vars in 961 bytes} [Sat Sep 24 20:45:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:45:29.469318 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96f2b-c5c6-48f3-89f2-69502810855d None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:29.469606 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96f2b-c5c6-48f3-89f2-69502810855d None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:29.469883 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f96f2b-c5c6-48f3-89f2-69502810855d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:29.474786 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91577e4e-0273-4d48-97c4-2df73480e452 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:29.496911 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-22f96f2b-c5c6-48f3-89f2-69502810855d None None] MFA Rules not processed for user `bc96ad30b91b46af92ff5b27a6b83abd`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:29.498536 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-22f96f2b-c5c6-48f3-89f2-69502810855d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:29.507929 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 610/1205] 10.222.0.61 () {58 vars in 1058 bytes} [Sat Sep 24 20:45:29 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:45:29.514223 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694c93-f230-4601-9b63-e4d188a130a6 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:29.514522 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694c93-f230-4601-9b63-e4d188a130a6 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:29.515056 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694c93-f230-4601-9b63-e4d188a130a6 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:29.516837 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 611/1206] 10.222.0.61 () {54 vars in 912 bytes} [Sat Sep 24 20:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 20:45:29.523297 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff04dfb-d89f-48c6-a985-b6eed43934a5 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:29.523584 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff04dfb-d89f-48c6-a985-b6eed43934a5 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:29.523989 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff04dfb-d89f-48c6-a985-b6eed43934a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:29.548478 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-cff04dfb-d89f-48c6-a985-b6eed43934a5 None None] MFA Rules not processed for user `bc96ad30b91b46af92ff5b27a6b83abd`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:29.550110 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-cff04dfb-d89f-48c6-a985-b6eed43934a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:29.560717 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 612/1207] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Sep 24 20:45:29 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:45:29.573533 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff04dfb-d89f-48c6-a985-b6eed43934a5 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:29.573728 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91577e4e-0273-4d48-97c4-2df73480e452 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:29.579726 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e048a-9fcb-408e-bdeb-567a2eb482fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3060c5a247f495990fd7eec99c0ee0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:29.580554 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e048a-9fcb-408e-bdeb-567a2eb482fe service placement] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:29.580845 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e048a-9fcb-408e-bdeb-567a2eb482fe service placement] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:29.581121 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e048a-9fcb-408e-bdeb-567a2eb482fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:29.583266 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-399e048a-9fcb-408e-bdeb-567a2eb482fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:29.585029 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff04dfb-d89f-48c6-a985-b6eed43934a5 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:29.589616 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde9584-c442-4eff-af3d-e123db488d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:29.590338 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde9584-c442-4eff-af3d-e123db488d4c service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:29.590716 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde9584-c442-4eff-af3d-e123db488d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:29.591107 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde9584-c442-4eff-af3d-e123db488d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:29.598969 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e048a-9fcb-408e-bdeb-567a2eb482fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:29.601272 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e048a-9fcb-408e-bdeb-567a2eb482fe service placement] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:29.602837 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde9584-c442-4eff-af3d-e123db488d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:29.604317 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde9584-c442-4eff-af3d-e123db488d4c service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:29.611816 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 596/1208] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:45:29 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:45:29.623802 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 613/1209] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:45:29 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:45:39.515292 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065f40b-02b6-439f-8a99-eed00e2c69a4 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:39.515922 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065f40b-02b6-439f-8a99-eed00e2c69a4 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:39.515922 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065f40b-02b6-439f-8a99-eed00e2c69a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:39.537493 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-f065f40b-02b6-439f-8a99-eed00e2c69a4 None None] MFA Rules not processed for user `0e97928ca3294ebdbc53468d84c64b26`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:39.538891 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-f065f40b-02b6-439f-8a99-eed00e2c69a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:39.546256 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 597/1210] 10.222.0.71 () {58 vars in 1015 bytes} [Sat Sep 24 20:45:39 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:45:39.562997 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde9584-c442-4eff-af3d-e123db488d4c service neutron] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:39.572099 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde9584-c442-4eff-af3d-e123db488d4c service neutron] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:39.576653 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da5272-f580-4b9e-ba8c-9b2451da280f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:39.577267 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da5272-f580-4b9e-ba8c-9b2451da280f service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:39.577545 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da5272-f580-4b9e-ba8c-9b2451da280f service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:39.577821 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da5272-f580-4b9e-ba8c-9b2451da280f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:39.586204 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da5272-f580-4b9e-ba8c-9b2451da280f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:39.587676 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da5272-f580-4b9e-ba8c-9b2451da280f service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:39.596163 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 614/1211] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:45:39 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:45:40.440902 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5b486-c857-4c48-bffc-3e95dc969f1c None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:40.441439 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5b486-c857-4c48-bffc-3e95dc969f1c None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:40.441722 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5b486-c857-4c48-bffc-3e95dc969f1c None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:40.443070 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 598/1212] 10.222.0.61 () {54 vars in 921 bytes} [Sat Sep 24 20:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:45:40.636649 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a316bc-185d-4b02-ad93-afd8bcd04b6b None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:40.637235 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a316bc-185d-4b02-ad93-afd8bcd04b6b None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:40.637235 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a316bc-185d-4b02-ad93-afd8bcd04b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:40.677030 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-23a316bc-185d-4b02-ad93-afd8bcd04b6b None None] MFA Rules not processed for user `bc96ad30b91b46af92ff5b27a6b83abd`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:40.679331 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-23a316bc-185d-4b02-ad93-afd8bcd04b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:40.695109 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 615/1213] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Sep 24 20:45:40 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:45:40.729252 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5b486-c857-4c48-bffc-3e95dc969f1c None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:40.748684 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5b486-c857-4c48-bffc-3e95dc969f1c None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:40.754538 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a13aa3-12c3-4b58-b151-416284d5638c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:40.755153 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a13aa3-12c3-4b58-b151-416284d5638c service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:40.755431 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a13aa3-12c3-4b58-b151-416284d5638c service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:40.755786 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a13aa3-12c3-4b58-b151-416284d5638c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:40.765781 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a13aa3-12c3-4b58-b151-416284d5638c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:40.767346 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a13aa3-12c3-4b58-b151-416284d5638c service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:40.778001 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 599/1214] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:45:40 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:45:47.359723 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635c6d3-db5c-4b7e-acdd-8bc4e4097869 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:47.360718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635c6d3-db5c-4b7e-acdd-8bc4e4097869 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:47.360718 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635c6d3-db5c-4b7e-acdd-8bc4e4097869 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:47.361674 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 616/1215] 10.222.0.61 () {54 vars in 921 bytes} [Sat Sep 24 20:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:45:47.386605 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85562812-8dfc-4af2-8558-44673d32e1d5 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:47.387465 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85562812-8dfc-4af2-8558-44673d32e1d5 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:47.387704 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85562812-8dfc-4af2-8558-44673d32e1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:47.417077 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-85562812-8dfc-4af2-8558-44673d32e1d5 None None] MFA Rules not processed for user `bc96ad30b91b46af92ff5b27a6b83abd`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:45:47.419011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-85562812-8dfc-4af2-8558-44673d32e1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:45:47.433503 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 600/1216] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Sep 24 20:45:47 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 20:45:47.454548 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635c6d3-db5c-4b7e-acdd-8bc4e4097869 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:45:47.475980 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635c6d3-db5c-4b7e-acdd-8bc4e4097869 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:45:47.484355 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5461f3c-5b75-4e00-95f7-4701c7ed2614 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:45:47.485356 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5461f3c-5b75-4e00-95f7-4701c7ed2614 service nova] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:45:47.485872 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5461f3c-5b75-4e00-95f7-4701c7ed2614 service nova] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:45:47.486314 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5461f3c-5b75-4e00-95f7-4701c7ed2614 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:45:47.500678 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5461f3c-5b75-4e00-95f7-4701c7ed2614 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:45:47.504028 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5461f3c-5b75-4e00-95f7-4701c7ed2614 service nova] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:45:47.516885 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 617/1217] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:45:47 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:45:57.409124 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=55 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:45:57.511853 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=62 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:46:00.569998 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85562812-8dfc-4af2-8558-44673d32e1d5 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:46:00.584778 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85562812-8dfc-4af2-8558-44673d32e1d5 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:46:00.591231 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e4fb0-8f62-42de-9a61-edeb953697d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:46:00.592236 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e4fb0-8f62-42de-9a61-edeb953697d1 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:46:00.592751 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e4fb0-8f62-42de-9a61-edeb953697d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:46:00.593217 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e4fb0-8f62-42de-9a61-edeb953697d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:46:00.606824 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e4fb0-8f62-42de-9a61-edeb953697d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:46:00.608261 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e4fb0-8f62-42de-9a61-edeb953697d1 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:46:00.618818 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 601/1218] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:46:00 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:46:03.026320 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3a29c-7ec6-4489-b621-779b750f22ea None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:46:03.027266 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3a29c-7ec6-4489-b621-779b750f22ea None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:46:03.027830 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3a29c-7ec6-4489-b621-779b750f22ea None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:46:03.031548 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 618/1219] 10.222.0.61 () {54 vars in 921 bytes} [Sat Sep 24 20:46:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:46:03.039110 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881e5df-c66c-46e0-83be-5ccad57f97ca None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:46:03.040248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881e5df-c66c-46e0-83be-5ccad57f97ca None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:46:03.040678 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881e5df-c66c-46e0-83be-5ccad57f97ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:46:03.076842 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-8881e5df-c66c-46e0-83be-5ccad57f97ca None None] MFA Rules not processed for user `bc96ad30b91b46af92ff5b27a6b83abd`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:46:03.078922 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-8881e5df-c66c-46e0-83be-5ccad57f97ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:46:03.112756 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 602/1220] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Sep 24 20:46:03 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:46:03.131005 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3a29c-7ec6-4489-b621-779b750f22ea None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:46:03.147965 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3a29c-7ec6-4489-b621-779b750f22ea None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:46:03.154781 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea31757c-2a29-4f05-95bb-09048bcbb485 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:46:03.155817 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31757c-2a29-4f05-95bb-09048bcbb485 service nova] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:46:03.156438 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31757c-2a29-4f05-95bb-09048bcbb485 service nova] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:46:03.156884 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31757c-2a29-4f05-95bb-09048bcbb485 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:46:03.175949 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31757c-2a29-4f05-95bb-09048bcbb485 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:46:03.178946 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea31757c-2a29-4f05-95bb-09048bcbb485 service nova] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:46:03.191381 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 619/1221] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:46:03 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:46:13.067829 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=9 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:46:13.185907 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=6 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:46:21.727667 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255373a-ba26-480c-a5c4-ffd98ddd3282 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:46:21.728378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255373a-ba26-480c-a5c4-ffd98ddd3282 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:46:21.728378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255373a-ba26-480c-a5c4-ffd98ddd3282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:46:21.747514 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-1255373a-ba26-480c-a5c4-ffd98ddd3282 None None] MFA Rules not processed for user `9bdb4c25481d4e41acd086dafcd08206`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:46:21.748751 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-1255373a-ba26-480c-a5c4-ffd98ddd3282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:46:21.755733 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 603/1222] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:46:21 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:46:22.177839 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e944b51-f1be-4fbf-8691-3cfc9c0c302f None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:46:22.177839 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e944b51-f1be-4fbf-8691-3cfc9c0c302f None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:46:22.177839 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e944b51-f1be-4fbf-8691-3cfc9c0c302f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:46:22.197069 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-9e944b51-f1be-4fbf-8691-3cfc9c0c302f None None] MFA Rules not processed for user `0e97928ca3294ebdbc53468d84c64b26`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:46:22.198299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-9e944b51-f1be-4fbf-8691-3cfc9c0c302f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:46:22.205002 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 620/1223] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Sep 24 20:46:22 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:46:22.216242 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255373a-ba26-480c-a5c4-ffd98ddd3282 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:46:22.225834 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255373a-ba26-480c-a5c4-ffd98ddd3282 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:46:22.229453 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c46a4-22fd-41d8-8f9e-ed42010a6db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:46:22.230051 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c46a4-22fd-41d8-8f9e-ed42010a6db8 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:46:22.230318 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c46a4-22fd-41d8-8f9e-ed42010a6db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:46:22.230612 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c46a4-22fd-41d8-8f9e-ed42010a6db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:46:22.239255 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c46a4-22fd-41d8-8f9e-ed42010a6db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:46:22.240728 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c46a4-22fd-41d8-8f9e-ed42010a6db8 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:46:22.250353 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 604/1224] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:46:22 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:46:32.191602 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=3 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:46:32.245779 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=9 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:46:46.151777 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a668a9d-d663-4502-92a5-196ccf513a64 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:46:46.152316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a668a9d-d663-4502-92a5-196ccf513a64 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:46:46.152316 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a668a9d-d663-4502-92a5-196ccf513a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:46:46.181438 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-5a668a9d-d663-4502-92a5-196ccf513a64 None None] MFA Rules not processed for user `9bdb4c25481d4e41acd086dafcd08206`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:46:46.183242 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-5a668a9d-d663-4502-92a5-196ccf513a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:46:46.193790 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 621/1225] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:46:46 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:46:56.178767 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=3 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:46:59.589011 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae8481-02d8-44d1-b3bb-b9003cfde8bc None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:46:59.589576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae8481-02d8-44d1-b3bb-b9003cfde8bc None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:46:59.589576 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae8481-02d8-44d1-b3bb-b9003cfde8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:46:59.611597 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-73ae8481-02d8-44d1-b3bb-b9003cfde8bc None None] MFA Rules not processed for user `9bdb4c25481d4e41acd086dafcd08206`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:46:59.612912 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-73ae8481-02d8-44d1-b3bb-b9003cfde8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:46:59.620520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 605/1226] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:46:59 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:47:09.605159 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=3 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:47:57.293926 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbdb4f-c9cd-461d-bab7-9801cbf1b547 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:47:57.294417 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbdb4f-c9cd-461d-bab7-9801cbf1b547 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:47:57.294501 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dbdb4f-c9cd-461d-bab7-9801cbf1b547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:47:57.313382 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-c2dbdb4f-c9cd-461d-bab7-9801cbf1b547 None None] MFA Rules not processed for user `9bdb4c25481d4e41acd086dafcd08206`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:47:57.314564 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-c2dbdb4f-c9cd-461d-bab7-9801cbf1b547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:47:57.321915 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 622/1227] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:47:57 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:48:07.308237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=3 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:48:07.734613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae8481-02d8-44d1-b3bb-b9003cfde8bc None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:48:07.752995 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae8481-02d8-44d1-b3bb-b9003cfde8bc None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:48:07.756494 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69899b20-8b5c-405d-b607-2a689bfd6929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:48:07.757088 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69899b20-8b5c-405d-b607-2a689bfd6929 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:48:07.757365 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69899b20-8b5c-405d-b607-2a689bfd6929 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:48:07.757641 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69899b20-8b5c-405d-b607-2a689bfd6929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:48:07.766263 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69899b20-8b5c-405d-b607-2a689bfd6929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:48:07.767660 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69899b20-8b5c-405d-b607-2a689bfd6929 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:48:07.777180 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 606/1228] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:48:07 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:48:17.773275 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=10 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:28.305068 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbdb4f-c9cd-461d-bab7-9801cbf1b547 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:49:28.325647 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dbdb4f-c9cd-461d-bab7-9801cbf1b547 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:49:28.330597 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befe52d-9f87-427a-9639-9e6bcc1e167d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3060c5a247f495990fd7eec99c0ee0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:49:28.331187 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befe52d-9f87-427a-9639-9e6bcc1e167d service placement] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:49:28.331465 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befe52d-9f87-427a-9639-9e6bcc1e167d service placement] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:49:28.331734 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befe52d-9f87-427a-9639-9e6bcc1e167d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:49:28.340537 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befe52d-9f87-427a-9639-9e6bcc1e167d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:49:28.342097 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befe52d-9f87-427a-9639-9e6bcc1e167d service placement] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:49:28.352188 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 623/1229] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:49:28 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:49:38.347596 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=10 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:49:45.822730 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8fd8f-2067-49b9-9bfa-8c1118439f35 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:49:45.823223 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8fd8f-2067-49b9-9bfa-8c1118439f35 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:49:45.823347 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8fd8f-2067-49b9-9bfa-8c1118439f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:49:45.842358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-4bb8fd8f-2067-49b9-9bfa-8c1118439f35 None None] MFA Rules not processed for user `60082b3cc2584a168371494e8ce0c59d`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:49:45.843541 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-4bb8fd8f-2067-49b9-9bfa-8c1118439f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:49:45.850880 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 607/1230] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:49:45 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:49:55.837644 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=3 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:17.042579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befe52d-9f87-427a-9639-9e6bcc1e167d service placement] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:50:17.063543 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befe52d-9f87-427a-9639-9e6bcc1e167d service placement] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:50:17.069615 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c169f6-bbe1-4c98-8b66-315060e648fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:50:17.070226 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c169f6-bbe1-4c98-8b66-315060e648fc service nova] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:50:17.070506 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c169f6-bbe1-4c98-8b66-315060e648fc service nova] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:50:17.070779 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c169f6-bbe1-4c98-8b66-315060e648fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:50:17.079579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c169f6-bbe1-4c98-8b66-315060e648fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:50:17.081214 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c169f6-bbe1-4c98-8b66-315060e648fc service nova] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:50:17.090994 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 624/1231] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:50:17 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:50:18.258013 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0545b-dd06-4c7a-bed3-c6da9cf49ce9 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:50:18.258534 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0545b-dd06-4c7a-bed3-c6da9cf49ce9 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:50:18.258534 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0545b-dd06-4c7a-bed3-c6da9cf49ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:50:18.277737 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-2ac0545b-dd06-4c7a-bed3-c6da9cf49ce9 None None] MFA Rules not processed for user `9bdb4c25481d4e41acd086dafcd08206`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:50:18.278989 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-2ac0545b-dd06-4c7a-bed3-c6da9cf49ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:50:18.286377 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 608/1232] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:50:18 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:50:27.086686 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=10 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:28.272029 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=3 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:28.711703 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c169f6-bbe1-4c98-8b66-315060e648fc service nova] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:50:28.721428 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c169f6-bbe1-4c98-8b66-315060e648fc service nova] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:50:28.725752 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeedcf4-9f16-4014-98f7-f39071a6599d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:50:28.726389 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeedcf4-9f16-4014-98f7-f39071a6599d service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:50:28.726671 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeedcf4-9f16-4014-98f7-f39071a6599d service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:50:28.726992 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeedcf4-9f16-4014-98f7-f39071a6599d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:50:28.738385 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeedcf4-9f16-4014-98f7-f39071a6599d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:50:28.739984 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeedcf4-9f16-4014-98f7-f39071a6599d service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:50:28.750772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 625/1233] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:50:28 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:50:29.959540 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0545b-dd06-4c7a-bed3-c6da9cf49ce9 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:50:29.969289 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0545b-dd06-4c7a-bed3-c6da9cf49ce9 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:50:29.973432 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dde1bb-0f89-4cbc-866c-548f9f0ce2fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:50:29.974053 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dde1bb-0f89-4cbc-866c-548f9f0ce2fb service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:50:29.974335 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dde1bb-0f89-4cbc-866c-548f9f0ce2fb service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:50:29.974613 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dde1bb-0f89-4cbc-866c-548f9f0ce2fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:50:29.984821 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dde1bb-0f89-4cbc-866c-548f9f0ce2fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:50:29.986269 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dde1bb-0f89-4cbc-866c-548f9f0ce2fb service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:50:29.998012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 609/1234] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:50:29 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:50:36.822972 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeedcf4-9f16-4014-98f7-f39071a6599d service neutron] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:50:36.834388 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeedcf4-9f16-4014-98f7-f39071a6599d service neutron] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:50:36.840165 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53800695-5c45-4c43-b9f5-82598df7bedb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:50:36.840842 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53800695-5c45-4c43-b9f5-82598df7bedb service nova] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:50:36.841126 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53800695-5c45-4c43-b9f5-82598df7bedb service nova] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:50:36.841432 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53800695-5c45-4c43-b9f5-82598df7bedb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:50:36.850573 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53800695-5c45-4c43-b9f5-82598df7bedb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:50:36.852709 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53800695-5c45-4c43-b9f5-82598df7bedb service nova] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:50:36.863593 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 626/1235] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:50:36 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:50:39.993135 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=6 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:50:46.858490 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=12 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:27.474037 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dde1bb-0f89-4cbc-866c-548f9f0ce2fb service neutron] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:51:27.493588 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dde1bb-0f89-4cbc-866c-548f9f0ce2fb service neutron] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:51:27.500252 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7538c98-40f6-4bbc-8c50-e8d8e453f25c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:51:27.501585 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7538c98-40f6-4bbc-8c50-e8d8e453f25c service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:51:27.502403 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7538c98-40f6-4bbc-8c50-e8d8e453f25c service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:51:27.502918 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7538c98-40f6-4bbc-8c50-e8d8e453f25c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:51:27.526248 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7538c98-40f6-4bbc-8c50-e8d8e453f25c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:51:27.533060 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7538c98-40f6-4bbc-8c50-e8d8e453f25c service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:51:27.553160 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 610/1236] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:51:27 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:51:27.643315 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53800695-5c45-4c43-b9f5-82598df7bedb service nova] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:51:27.662533 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53800695-5c45-4c43-b9f5-82598df7bedb service nova] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:51:27.669937 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bdfe4-2c23-4829-94e8-3ac2261fed10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:51:27.671209 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bdfe4-2c23-4829-94e8-3ac2261fed10 service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:51:27.671827 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bdfe4-2c23-4829-94e8-3ac2261fed10 service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:51:27.672936 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bdfe4-2c23-4829-94e8-3ac2261fed10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:51:27.686874 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bdfe4-2c23-4829-94e8-3ac2261fed10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:51:27.691414 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bdfe4-2c23-4829-94e8-3ac2261fed10 service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:51:27.710934 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 627/1237] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:51:27 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:51:29.104651 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7538c98-40f6-4bbc-8c50-e8d8e453f25c service nova] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:51:29.129445 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7538c98-40f6-4bbc-8c50-e8d8e453f25c service nova] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:51:29.135114 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91626db8-d81a-4a6d-8987-e968fc34e2bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:51:29.136032 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91626db8-d81a-4a6d-8987-e968fc34e2bd service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:51:29.136318 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91626db8-d81a-4a6d-8987-e968fc34e2bd service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:51:29.136629 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91626db8-d81a-4a6d-8987-e968fc34e2bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:51:29.160305 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91626db8-d81a-4a6d-8987-e968fc34e2bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:51:29.162721 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91626db8-d81a-4a6d-8987-e968fc34e2bd service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:51:29.192417 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 611/1238] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:51:29 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:51:36.291926 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bdfe4-2c23-4829-94e8-3ac2261fed10 service neutron] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:51:36.304327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bdfe4-2c23-4829-94e8-3ac2261fed10 service neutron] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:51:36.310617 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b5679-43a9-48e1-9f8a-38f78f52f72f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:51:36.311322 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b5679-43a9-48e1-9f8a-38f78f52f72f service neutron] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:51:36.311654 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b5679-43a9-48e1-9f8a-38f78f52f72f service neutron] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:51:36.311936 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b5679-43a9-48e1-9f8a-38f78f52f72f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:51:36.382563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b5679-43a9-48e1-9f8a-38f78f52f72f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:51:36.384129 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b5679-43a9-48e1-9f8a-38f78f52f72f service neutron] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:51:36.405882 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 628/1239] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:51:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:51:39.171168 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=12 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:40.269754 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100003e-f4c0-4670-8838-e0900720378e None None] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:51:40.270545 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100003e-f4c0-4670-8838-e0900720378e None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:51:40.270915 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100003e-f4c0-4670-8838-e0900720378e None None] PATH_INFO: `/` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:51:40.273478 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 612/1240] 10.222.0.61 () {54 vars in 921 bytes} [Sat Sep 24 20:51:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:51:40.323563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d347950-991a-4b73-b78e-3e235c45e29b None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:51:40.329376 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d347950-991a-4b73-b78e-3e235c45e29b None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:51:40.329976 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d347950-991a-4b73-b78e-3e235c45e29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:51:40.452291 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-0d347950-991a-4b73-b78e-3e235c45e29b None None] MFA Rules not processed for user `d3060c5a247f495990fd7eec99c0ee0a`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:51:40.454791 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-0d347950-991a-4b73-b78e-3e235c45e29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:51:40.470486 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 629/1241] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Sep 24 20:51:40 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:51:40.484882 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100003e-f4c0-4670-8838-e0900720378e None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:51:40.503119 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100003e-f4c0-4670-8838-e0900720378e None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:51:40.509271 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c46f1-f1b0-48e6-9959-28a63806a873 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3060c5a247f495990fd7eec99c0ee0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:51:40.510189 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c46f1-f1b0-48e6-9959-28a63806a873 service placement] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:51:40.511122 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c46f1-f1b0-48e6-9959-28a63806a873 service placement] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:51:40.511548 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c46f1-f1b0-48e6-9959-28a63806a873 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:51:40.522065 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c46f1-f1b0-48e6-9959-28a63806a873 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:51:40.523922 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c46f1-f1b0-48e6-9959-28a63806a873 service placement] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:51:40.536617 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 613/1242] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:51:40 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:51:44.321875 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d347950-991a-4b73-b78e-3e235c45e29b None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:51:44.338131 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d347950-991a-4b73-b78e-3e235c45e29b None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:51:44.342892 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d971da-ac71-4bf3-a6e3-610f6df274e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:51:44.344016 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d971da-ac71-4bf3-a6e3-610f6df274e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:51:44.344288 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d971da-ac71-4bf3-a6e3-610f6df274e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:51:44.344588 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d971da-ac71-4bf3-a6e3-610f6df274e7 admin admin] PATH_INFO: `/v3/users/60082b3cc2584a168371494e8ce0c59d` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:51:44.345752 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d971da-ac71-4bf3-a6e3-610f6df274e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60082b3cc2584a168371494e8ce0c59d)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:51:44.347280 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: WARNING py.warnings [None req-a0d971da-ac71-4bf3-a6e3-610f6df274e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 20:51:44.347280 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: warnings.warn(msg) Sep 24 20:51:44.347280 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: Sep 24 20:51:44.349031 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d971da-ac71-4bf3-a6e3-610f6df274e7 admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:51:44.424883 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-a0d971da-ac71-4bf3-a6e3-610f6df274e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60082b3cc2584a168371494e8ce0c59d'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:44.436915 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-a0d971da-ac71-4bf3-a6e3-610f6df274e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60082b3cc2584a168371494e8ce0c59d'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:44.438222 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-a0d971da-ac71-4bf3-a6e3-610f6df274e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60082b3cc2584a168371494e8ce0c59d'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:44.447214 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-a0d971da-ac71-4bf3-a6e3-610f6df274e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60082b3cc2584a168371494e8ce0c59d'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:44.471017 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-a0d971da-ac71-4bf3-a6e3-610f6df274e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60082b3cc2584a168371494e8ce0c59d'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:44.477651 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 630/1243] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Sep 24 20:51:44 2022] DELETE /identity/v3/users/60082b3cc2584a168371494e8ce0c59d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:51:44.700632 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c46f1-f1b0-48e6-9959-28a63806a873 service placement] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:51:44.718952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c46f1-f1b0-48e6-9959-28a63806a873 service placement] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:51:44.785919 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5200c38-6156-4f29-a53e-95dc8807a9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:51:44.786558 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5200c38-6156-4f29-a53e-95dc8807a9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:51:44.786842 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5200c38-6156-4f29-a53e-95dc8807a9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:51:44.787118 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5200c38-6156-4f29-a53e-95dc8807a9c0 admin admin] PATH_INFO: `/v3/projects/cfa11f4a154f4696b2ba00e091941b8f` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:51:44.788260 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5200c38-6156-4f29-a53e-95dc8807a9c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa11f4a154f4696b2ba00e091941b8f)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:51:44.789313 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: WARNING py.warnings [None req-e5200c38-6156-4f29-a53e-95dc8807a9c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 20:51:44.789313 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: warnings.warn(msg) Sep 24 20:51:44.789313 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: Sep 24 20:51:44.790521 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5200c38-6156-4f29-a53e-95dc8807a9c0 admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:51:44.862206 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-e5200c38-6156-4f29-a53e-95dc8807a9c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa11f4a154f4696b2ba00e091941b8f', 'request_id': 'req-e5200c38-6156-4f29-a53e-95dc8807a9c0'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:44.876403 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-e5200c38-6156-4f29-a53e-95dc8807a9c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa11f4a154f4696b2ba00e091941b8f', 'request_id': 'req-e5200c38-6156-4f29-a53e-95dc8807a9c0'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:44.887598 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-e5200c38-6156-4f29-a53e-95dc8807a9c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa11f4a154f4696b2ba00e091941b8f', 'request_id': 'req-e5200c38-6156-4f29-a53e-95dc8807a9c0'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:44.901267 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-e5200c38-6156-4f29-a53e-95dc8807a9c0 admin admin] The token cache is being invalidate because project cfa11f4a154f4696b2ba00e091941b8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:51:44.901548 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-e5200c38-6156-4f29-a53e-95dc8807a9c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:44.902378 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-e5200c38-6156-4f29-a53e-95dc8807a9c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:44.905226 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 614/1244] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Sep 24 20:51:44 2022] DELETE /identity/v3/projects/cfa11f4a154f4696b2ba00e091941b8f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:51:44.912772 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d971da-ac71-4bf3-a6e3-610f6df274e7 admin admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:51:44.915033 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-a0d971da-ac71-4bf3-a6e3-610f6df274e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:51:44.925444 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:44.929567 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d971da-ac71-4bf3-a6e3-610f6df274e7 admin admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:51:45.003053 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80136a-874f-4a3b-9191-a709f0ba4050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:51:45.003587 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80136a-874f-4a3b-9191-a709f0ba4050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:51:45.003870 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80136a-874f-4a3b-9191-a709f0ba4050 admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:51:45.004143 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80136a-874f-4a3b-9191-a709f0ba4050 admin admin] PATH_INFO: `/v3/users/67cadebf94f5462eb354bf03efb84423` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:51:45.005451 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80136a-874f-4a3b-9191-a709f0ba4050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67cadebf94f5462eb354bf03efb84423)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:51:45.007351 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80136a-874f-4a3b-9191-a709f0ba4050 admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:51:45.067356 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-7b80136a-874f-4a3b-9191-a709f0ba4050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67cadebf94f5462eb354bf03efb84423'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:45.076638 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-7b80136a-874f-4a3b-9191-a709f0ba4050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67cadebf94f5462eb354bf03efb84423'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:45.077392 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-7b80136a-874f-4a3b-9191-a709f0ba4050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67cadebf94f5462eb354bf03efb84423'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:45.085584 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-7b80136a-874f-4a3b-9191-a709f0ba4050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67cadebf94f5462eb354bf03efb84423'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:45.100465 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-7b80136a-874f-4a3b-9191-a709f0ba4050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67cadebf94f5462eb354bf03efb84423'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:45.109794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 631/1245] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Sep 24 20:51:44 2022] DELETE /identity/v3/users/67cadebf94f5462eb354bf03efb84423 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:51:45.337595 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5200c38-6156-4f29-a53e-95dc8807a9c0 admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:51:45.340090 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-e5200c38-6156-4f29-a53e-95dc8807a9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:51:45.361057 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5200c38-6156-4f29-a53e-95dc8807a9c0 admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:51:45.441012 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81d8af-e537-4c1c-bb63-71a4c619f825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:51:45.441900 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81d8af-e537-4c1c-bb63-71a4c619f825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:51:45.442258 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81d8af-e537-4c1c-bb63-71a4c619f825 admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:51:45.442743 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81d8af-e537-4c1c-bb63-71a4c619f825 admin admin] PATH_INFO: `/v3/projects/41bcc59c32794af594ec0b0e421ad983` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:51:45.444665 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81d8af-e537-4c1c-bb63-71a4c619f825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41bcc59c32794af594ec0b0e421ad983)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:51:45.448249 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b81d8af-e537-4c1c-bb63-71a4c619f825 admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:51:45.477262 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:45.509764 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-5b81d8af-e537-4c1c-bb63-71a4c619f825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41bcc59c32794af594ec0b0e421ad983', 'request_id': 'req-5b81d8af-e537-4c1c-bb63-71a4c619f825'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:45.516861 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-5b81d8af-e537-4c1c-bb63-71a4c619f825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41bcc59c32794af594ec0b0e421ad983', 'request_id': 'req-5b81d8af-e537-4c1c-bb63-71a4c619f825'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:45.525848 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-5b81d8af-e537-4c1c-bb63-71a4c619f825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41bcc59c32794af594ec0b0e421ad983', 'request_id': 'req-5b81d8af-e537-4c1c-bb63-71a4c619f825'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:45.538680 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-5b81d8af-e537-4c1c-bb63-71a4c619f825 admin admin] The token cache is being invalidate because project 41bcc59c32794af594ec0b0e421ad983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94880) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:51:45.538973 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-5b81d8af-e537-4c1c-bb63-71a4c619f825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:45.539662 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-5b81d8af-e537-4c1c-bb63-71a4c619f825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:51:45.541218 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 615/1246] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Sep 24 20:51:45 2022] DELETE /identity/v3/projects/41bcc59c32794af594ec0b0e421ad983 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:51:55.103327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:51:55.535415 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:12.167039 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfad440-60c1-4d23-8683-2499d3362486 None None] REQUEST_METHOD: `POST` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:52:12.167892 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfad440-60c1-4d23-8683-2499d3362486 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:52:12.167892 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfad440-60c1-4d23-8683-2499d3362486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:52:12.207842 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.auth.core [None req-9bfad440-60c1-4d23-8683-2499d3362486 None None] MFA Rules not processed for user `9bdb4c25481d4e41acd086dafcd08206`. Rule list: `[]` (Enabled: `True`). {{(pid=94879) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:52:12.209237 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-9bfad440-60c1-4d23-8683-2499d3362486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:52:12.299252 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 632/1247] 10.222.0.61 () {58 vars in 958 bytes} [Sat Sep 24 20:52:12 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:52:12.730819 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81d8af-e537-4c1c-bb63-71a4c619f825 admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:52:12.733339 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-5b81d8af-e537-4c1c-bb63-71a4c619f825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:52:12.826821 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81d8af-e537-4c1c-bb63-71a4c619f825 admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:52:12.831569 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d26de0-05f0-4294-ac9f-389249fa411b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:52:12.832368 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d26de0-05f0-4294-ac9f-389249fa411b service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:52:12.832735 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d26de0-05f0-4294-ac9f-389249fa411b service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:52:12.833017 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d26de0-05f0-4294-ac9f-389249fa411b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:52:12.834943 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-28d26de0-05f0-4294-ac9f-389249fa411b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:52:12.848679 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d26de0-05f0-4294-ac9f-389249fa411b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:52:12.850205 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d26de0-05f0-4294-ac9f-389249fa411b service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:52:12.858821 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 616/1248] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:52:12 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:52:13.411625 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfad440-60c1-4d23-8683-2499d3362486 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:52:13.413283 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-9bfad440-60c1-4d23-8683-2499d3362486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:52:13.525752 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfad440-60c1-4d23-8683-2499d3362486 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:52:13.531566 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8ee51-72a5-42fe-966e-8dd8cf7b8946 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3060c5a247f495990fd7eec99c0ee0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:52:13.532182 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8ee51-72a5-42fe-966e-8dd8cf7b8946 service placement] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:52:13.532502 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8ee51-72a5-42fe-966e-8dd8cf7b8946 service placement] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:52:13.532786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8ee51-72a5-42fe-966e-8dd8cf7b8946 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:52:13.534582 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-9cf8ee51-72a5-42fe-966e-8dd8cf7b8946 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:52:13.547043 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8ee51-72a5-42fe-966e-8dd8cf7b8946 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:52:13.548781 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8ee51-72a5-42fe-966e-8dd8cf7b8946 service placement] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:52:13.558752 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 633/1249] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:52:13 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 20:52:22.855139 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=28 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:23.145162 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d26de0-05f0-4294-ac9f-389249fa411b service neutron] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:52:23.147605 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-28d26de0-05f0-4294-ac9f-389249fa411b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:52:23.257536 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d26de0-05f0-4294-ac9f-389249fa411b service neutron] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:52:23.264123 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204b957-4d4d-4209-8237-efc642036a23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc96ad30b91b46af92ff5b27a6b83abd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:52:23.264952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204b957-4d4d-4209-8237-efc642036a23 service nova] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:52:23.265283 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204b957-4d4d-4209-8237-efc642036a23 service nova] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:52:23.265600 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204b957-4d4d-4209-8237-efc642036a23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:52:23.267796 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-4204b957-4d4d-4209-8237-efc642036a23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:52:23.284886 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204b957-4d4d-4209-8237-efc642036a23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:52:23.287925 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204b957-4d4d-4209-8237-efc642036a23 service nova] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:52:23.307520 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 617/1250] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:52:23 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:52:23.554585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=72 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:52:33.298988 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=32 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:31.282356 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066888a-c4bd-45c4-90d4-c92ef9969567 None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:54:31.282986 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066888a-c4bd-45c4-90d4-c92ef9969567 None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:54:31.282986 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066888a-c4bd-45c4-90d4-c92ef9969567 None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:54:31.284798 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 634/1251] 10.222.0.61 () {54 vars in 961 bytes} [Sat Sep 24 20:54:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:54:31.290065 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae3a2c-55bc-4f52-8c52-a23329ab8b49 None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:54:31.290521 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae3a2c-55bc-4f52-8c52-a23329ab8b49 None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:54:31.290691 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae3a2c-55bc-4f52-8c52-a23329ab8b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:54:31.327899 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-a3ae3a2c-55bc-4f52-8c52-a23329ab8b49 None None] MFA Rules not processed for user `d3060c5a247f495990fd7eec99c0ee0a`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:54:31.329165 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-a3ae3a2c-55bc-4f52-8c52-a23329ab8b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:54:31.357064 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 618/1252] 10.222.0.61 () {58 vars in 1058 bytes} [Sat Sep 24 20:54:31 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:54:31.365857 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066888a-c4bd-45c4-90d4-c92ef9969567 None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:54:31.383101 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066888a-c4bd-45c4-90d4-c92ef9969567 None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:54:31.389946 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6271db7-fe92-46ae-9d02-38b7bf564879 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3060c5a247f495990fd7eec99c0ee0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:54:31.391055 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6271db7-fe92-46ae-9d02-38b7bf564879 service placement] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:54:31.391445 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6271db7-fe92-46ae-9d02-38b7bf564879 service placement] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:54:31.391737 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6271db7-fe92-46ae-9d02-38b7bf564879 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:54:31.394056 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-c6271db7-fe92-46ae-9d02-38b7bf564879 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:54:31.408948 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6271db7-fe92-46ae-9d02-38b7bf564879 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:54:31.410533 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6271db7-fe92-46ae-9d02-38b7bf564879 service placement] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:54:31.421332 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 635/1253] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:54:31 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:54:41.350212 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=14 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:54:41.416372 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=6 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:01.941334 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae3a2c-55bc-4f52-8c52-a23329ab8b49 None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:55:01.951905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae3a2c-55bc-4f52-8c52-a23329ab8b49 None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:55:01.955508 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311e29d-9a17-4cbe-b982-268c3c640272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e97928ca3294ebdbc53468d84c64b26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:55:01.956121 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311e29d-9a17-4cbe-b982-268c3c640272 service neutron] REQUEST_METHOD: `GET` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:55:01.956446 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311e29d-9a17-4cbe-b982-268c3c640272 service neutron] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:55:01.956724 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311e29d-9a17-4cbe-b982-268c3c640272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:55:01.958657 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-2311e29d-9a17-4cbe-b982-268c3c640272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:55:02.047873 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311e29d-9a17-4cbe-b982-268c3c640272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:55:02.049367 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311e29d-9a17-4cbe-b982-268c3c640272 service neutron] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:55:02.058952 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 619/1254] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:55:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:55:05.499773 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86206a26-4556-40e4-9659-fc823aea10bd None None] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:55:05.500558 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86206a26-4556-40e4-9659-fc823aea10bd None None] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:55:05.500558 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86206a26-4556-40e4-9659-fc823aea10bd None None] PATH_INFO: `/` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:55:05.501786 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 636/1255] 10.222.0.61 () {54 vars in 921 bytes} [Sat Sep 24 20:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 20:55:05.527541 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b23a64-258d-4f95-91d2-a7b7063dd96d None None] REQUEST_METHOD: `POST` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:55:05.528136 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b23a64-258d-4f95-91d2-a7b7063dd96d None None] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:55:05.528136 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b23a64-258d-4f95-91d2-a7b7063dd96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:55:05.549202 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.auth.core [None req-57b23a64-258d-4f95-91d2-a7b7063dd96d None None] MFA Rules not processed for user `d3060c5a247f495990fd7eec99c0ee0a`. Rule list: `[]` (Enabled: `True`). {{(pid=94880) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 20:55:05.550445 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-57b23a64-258d-4f95-91d2-a7b7063dd96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:55:05.563512 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 620/1256] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Sep 24 20:55:05 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 20:55:05.578992 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86206a26-4556-40e4-9659-fc823aea10bd None None] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:55:05.594789 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86206a26-4556-40e4-9659-fc823aea10bd None None] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:55:05.601335 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe27748-da75-4355-b7d7-1635a95c7db3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3060c5a247f495990fd7eec99c0ee0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e446dc5c12d49bca59e6e8c8ad90341', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:55:05.602241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe27748-da75-4355-b7d7-1635a95c7db3 service placement] REQUEST_METHOD: `GET` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:55:05.602679 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe27748-da75-4355-b7d7-1635a95c7db3 service placement] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:55:05.603011 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe27748-da75-4355-b7d7-1635a95c7db3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:55:05.613719 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe27748-da75-4355-b7d7-1635a95c7db3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:55:05.615340 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe27748-da75-4355-b7d7-1635a95c7db3 service placement] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:55:05.626579 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 637/1257] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Sep 24 20:55:05 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 20:55:09.054358 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b23a64-258d-4f95-91d2-a7b7063dd96d None None] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:55:09.055868 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-57b23a64-258d-4f95-91d2-a7b7063dd96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:55:09.072550 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b23a64-258d-4f95-91d2-a7b7063dd96d None None] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:55:09.078489 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1211bb-e4ae-443a-a314-253c5fdada7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:55:09.079126 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1211bb-e4ae-443a-a314-253c5fdada7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:55:09.079408 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1211bb-e4ae-443a-a314-253c5fdada7b admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:55:09.079686 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1211bb-e4ae-443a-a314-253c5fdada7b admin admin] PATH_INFO: `/v3/users/9bdb4c25481d4e41acd086dafcd08206` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:55:09.093620 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1211bb-e4ae-443a-a314-253c5fdada7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bdb4c25481d4e41acd086dafcd08206)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:55:09.095545 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1211bb-e4ae-443a-a314-253c5fdada7b admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:55:09.146800 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-ea1211bb-e4ae-443a-a314-253c5fdada7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bdb4c25481d4e41acd086dafcd08206'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:09.159373 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-ea1211bb-e4ae-443a-a314-253c5fdada7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bdb4c25481d4e41acd086dafcd08206'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:09.160509 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-ea1211bb-e4ae-443a-a314-253c5fdada7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bdb4c25481d4e41acd086dafcd08206'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:09.166308 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-ea1211bb-e4ae-443a-a314-253c5fdada7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bdb4c25481d4e41acd086dafcd08206'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:09.176298 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-ea1211bb-e4ae-443a-a314-253c5fdada7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bdb4c25481d4e41acd086dafcd08206'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:09.189998 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 621/1258] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Sep 24 20:55:09 2022] DELETE /identity/v3/users/9bdb4c25481d4e41acd086dafcd08206 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:55:09.370563 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe27748-da75-4355-b7d7-1635a95c7db3 service placement] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:55:09.388509 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe27748-da75-4355-b7d7-1635a95c7db3 service placement] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:55:09.455024 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da94836-2b0a-4882-89dc-0715c4486d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:55:09.455674 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da94836-2b0a-4882-89dc-0715c4486d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:55:09.455958 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da94836-2b0a-4882-89dc-0715c4486d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:55:09.456397 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da94836-2b0a-4882-89dc-0715c4486d48 admin admin] PATH_INFO: `/v3/projects/c85330c84706491aaa619c8abc97f6a5` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:55:09.469833 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da94836-2b0a-4882-89dc-0715c4486d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c85330c84706491aaa619c8abc97f6a5)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:55:09.471794 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da94836-2b0a-4882-89dc-0715c4486d48 admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:55:09.518585 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-0da94836-2b0a-4882-89dc-0715c4486d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c85330c84706491aaa619c8abc97f6a5', 'request_id': 'req-0da94836-2b0a-4882-89dc-0715c4486d48'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:09.525392 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-0da94836-2b0a-4882-89dc-0715c4486d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c85330c84706491aaa619c8abc97f6a5', 'request_id': 'req-0da94836-2b0a-4882-89dc-0715c4486d48'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:09.535163 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-0da94836-2b0a-4882-89dc-0715c4486d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c85330c84706491aaa619c8abc97f6a5', 'request_id': 'req-0da94836-2b0a-4882-89dc-0715c4486d48'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:09.546327 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-0da94836-2b0a-4882-89dc-0715c4486d48 admin admin] The token cache is being invalidate because project c85330c84706491aaa619c8abc97f6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:55:09.546620 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-0da94836-2b0a-4882-89dc-0715c4486d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:09.547280 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-0da94836-2b0a-4882-89dc-0715c4486d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:09.548819 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 638/1259] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Sep 24 20:55:09 2022] DELETE /identity/v3/projects/c85330c84706491aaa619c8abc97f6a5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:55:09.552949 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1211bb-e4ae-443a-a314-253c5fdada7b admin admin] Authenticating user token {{(pid=94880) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:55:09.554638 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.fernet_utils [None req-ea1211bb-e4ae-443a-a314-253c5fdada7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94880) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:55:09.568067 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1211bb-e4ae-443a-a314-253c5fdada7b admin admin] Validating token access rules against request {{(pid=94880) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:55:09.599501 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:09.632095 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e7fba-ee3c-40d5-bab7-cc7b2873c2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94880) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:55:09.632765 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e7fba-ee3c-40d5-bab7-cc7b2873c2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:55:09.633045 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e7fba-ee3c-40d5-bab7-cc7b2873c2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:55:09.633420 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e7fba-ee3c-40d5-bab7-cc7b2873c2a5 admin admin] PATH_INFO: `/v3/users/f198a2d9c10e4898ab9e9ae9544dad7f` {{(pid=94880) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:55:09.634426 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e7fba-ee3c-40d5-bab7-cc7b2873c2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f198a2d9c10e4898ab9e9ae9544dad7f)` {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:55:09.636319 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e7fba-ee3c-40d5-bab7-cc7b2873c2a5 admin admin] RBAC: Authorization granted {{(pid=94880) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:55:09.686314 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-095e7fba-ee3c-40d5-bab7-cc7b2873c2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f198a2d9c10e4898ab9e9ae9544dad7f'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:09.693208 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-095e7fba-ee3c-40d5-bab7-cc7b2873c2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f198a2d9c10e4898ab9e9ae9544dad7f'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:09.693905 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-095e7fba-ee3c-40d5-bab7-cc7b2873c2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f198a2d9c10e4898ab9e9ae9544dad7f'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:09.694522 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-095e7fba-ee3c-40d5-bab7-cc7b2873c2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f198a2d9c10e4898ab9e9ae9544dad7f'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:09.707197 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG keystone.notifications [None req-095e7fba-ee3c-40d5-bab7-cc7b2873c2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f198a2d9c10e4898ab9e9ae9544dad7f'} {{(pid=94880) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:09.720995 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: [pid: 94880|app: 0|req: 622/1260] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Sep 24 20:55:09 2022] DELETE /identity/v3/users/f198a2d9c10e4898ab9e9ae9544dad7f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 20:55:09.904299 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da94836-2b0a-4882-89dc-0715c4486d48 admin admin] Authenticating user token {{(pid=94879) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 20:55:09.906228 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.fernet_utils [None req-0da94836-2b0a-4882-89dc-0715c4486d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=94879) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 20:55:09.922225 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da94836-2b0a-4882-89dc-0715c4486d48 admin admin] Validating token access rules against request {{(pid=94879) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 20:55:09.980932 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c2fa8-898c-40f5-8da3-1cc85b92e666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f6d7830fd8e4f16950273e6f89f703c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9733fd590bc408aa51b7edd8cdd8117', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=94879) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 20:55:09.981555 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c2fa8-898c-40f5-8da3-1cc85b92e666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 20:55:09.981827 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c2fa8-898c-40f5-8da3-1cc85b92e666 admin admin] SCRIPT_NAME: `/identity` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 20:55:09.982104 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c2fa8-898c-40f5-8da3-1cc85b92e666 admin admin] PATH_INFO: `/v3/projects/7b94ccdd894f40bfb62d3735c746c630` {{(pid=94879) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 20:55:09.983241 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c2fa8-898c-40f5-8da3-1cc85b92e666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b94ccdd894f40bfb62d3735c746c630)` {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 20:55:09.985166 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c2fa8-898c-40f5-8da3-1cc85b92e666 admin admin] RBAC: Authorization granted {{(pid=94879) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 20:55:09.995593 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:10.035342 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-772c2fa8-898c-40f5-8da3-1cc85b92e666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b94ccdd894f40bfb62d3735c746c630', 'request_id': 'req-772c2fa8-898c-40f5-8da3-1cc85b92e666'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:10.042174 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-772c2fa8-898c-40f5-8da3-1cc85b92e666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b94ccdd894f40bfb62d3735c746c630', 'request_id': 'req-772c2fa8-898c-40f5-8da3-1cc85b92e666'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:10.050587 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-772c2fa8-898c-40f5-8da3-1cc85b92e666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b94ccdd894f40bfb62d3735c746c630', 'request_id': 'req-772c2fa8-898c-40f5-8da3-1cc85b92e666'} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:10.063560 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-772c2fa8-898c-40f5-8da3-1cc85b92e666 admin admin] The token cache is being invalidate because project 7b94ccdd894f40bfb62d3735c746c630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=94879) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 20:55:10.063854 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-772c2fa8-898c-40f5-8da3-1cc85b92e666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:10.064533 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG keystone.notifications [None req-772c2fa8-898c-40f5-8da3-1cc85b92e666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=94879) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 20:55:10.066150 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: [pid: 94879|app: 0|req: 639/1261] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Sep 24 20:55:09 2022] DELETE /identity/v3/projects/7b94ccdd894f40bfb62d3735c746c630 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 20:55:19.717511 dv-osbrick-master-4-ceph devstack@keystone.service[94880]: DEBUG dbcounter [-] [94880] Writing DB stats keystone:SELECT=40,keystone:DELETE=10,keystone:INSERT=1 {{(pid=94880) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 20:55:20.060307 dv-osbrick-master-4-ceph devstack@keystone.service[94879]: DEBUG dbcounter [-] [94879] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=94879) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}